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ABSTRACT: 



Let Xat = {Xl , . . . , Xp ) be a family of NxN independent, normalized random matrices 
from the Gaussian Unitary Ensemble. We state sufficient conditions on matrices Y^r = 
. . . , Yq^^), possibly random but independent of Xat, for whicli tlie operator norm 
of P(XAr, Yjv, Y^) converges almost surely for all polynomials P. Limits are described by 
operator norms of objects from free probability theory. Taking advantage of the choice of the 
matrices and of the polynomials P, we get for a large class of matrices the "no eigenvalues 
outside a neighborhood of the limiting spectrum" phenomena. We give examples of diagonal 
matrices Yjv for which the convergence holds. Convergence of the operator norm is shown 
to hold for block matrices, even with rectangular Gaussian blocks, a situation including 
non-white Wishart matrices and some matrices encountered in MIMO systems. 

1 Introduction and statement of result 

For a Hermitian NxN matrix H^, let Chn denote its empirical eigenvalue distribution, namely 



where dx is the Dirac mass in A and Ai, . . . , Aa? are the eigenvalues of Hn. The empirical eigenvalue 
distribution of large dimensional random matrices has been studied with much interest for a long time. 
One pioneering result is Wigner's theorem jJT], from 1958. Let Wn he a,n N x N Wigner matrix. Then 
the theorem states that, under appropriate assumptions, the n-th moment of /CvKw converges in expecta- 
tion to the 71-th moment of the semicircular law as N goes to infinity for any integer n. This result has 
been generalized in many directions, notably by Arnold [5] for the almost sure convergence of the mo- 
ments. The convergence of the empirical eigenvalue distribution for covariance matrices was first shown 
by Marcenko and Pastur in 1967, and has been generalized in the late 1970's and the early 1980's by 
many people, including Grenander and Silverstein [16], Wachter [40], Jonsson [22], Yin and Krishnaiah 
[ii) . Bai, Yin and Krishnaiah [7J and Yin [i^ . 

In 1991, Voiculescu [37] discovered a connection between large random matrices and free probability 
theory. He showed the so-called asymptotic freeness theorem, which has been generalized for instance in 
|2H 1351 139] , which implies the almost sure weak convergence of the empirical eigenvalue distribution for 
Hermitian matrices Hn of the form 




where 
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• P is a fixed polynomial in 2p + q non commutative indeterminates, 

• Xat {x[^\ . . . ,Xp^^) is a family of independent N x N matrices of the normalized Gaussian 
Unitary Ensemble (GUE), 



• Yn = {yI^^\ . . . , Yq^'') are N xN matrices with appropriate assumptions (see Theorem 1.3 below) 



The limiting empirical eigenvalue distribution of if at can be computed by using the notion of free- 
ness. Recall that a.n N x N random matrix X^-^^^ is said to be a normalized GUE matrix if it is 
Hermitian with entries (^ra'[^)i^n,m^jv, such that the set of random variables (X^^'*)i^„^jv, and (v^Re 
i^n<m^N forms a centered Gaussian vector with covariance matrix -^l^v^. More- 
over, the result of Voiculescu holds even for independent Wigner or Wishart matrices instead of GUE 
matrices, as it has been proved by Dykema [13J and Capitaine and Casalis [9_ respectively. 



Currently, it is known for some random matrices, as for example Wigner and Wishart matrices, that, 
almost surely, the eigenvalues of the matrix belong to a small neighborhood of the limiting eigenvalue 
distribution for N large enough. More formally, if is a Hermitian matrix whose empirical eigenvalue 
distribution converges weakly to a probability measure fi it is observed in many situations [H 143) HI EJ [23] 
that : for all £ > 0, almost surely there exists Nq ^ 1 such that for all N ^ Nq one has 

Sp(i/^v) cSupp + (1-1) 
where " Sp " means the spectrum and " Supp " means the support. 



The convergence of the extremal eigenvalues to the edges of the spectrum of a single Wigner or Wishart 
matrix has been shown in the early 1980's by Geman [15_, Juhsisz f24|, Fiiredi and Komlos [TT, Jonsson 
|23) and Silverstein |i341 [33] • In 1988, in the case of a real Wigner matrix, Bai and Yin stated in |[B] 
necessary and sufficient conditions for the convergence in terms of the first four moments of the entries of 
these matrices. In the case of a Wishart matrix, the similar result is due to Yin, Bai, and Krishnaiah [33] 
and Bai, Silverstein, and Yin |4j. The case of a complex matrix has been investigated later by Bai [3J. The 
phenomenon "no eigenvalues outside (a small neighborhood of) the support of the limiting distribution" 
has been shown in 1998 by Bai and Silverstein [5"! for large sample covariance matrices and in 2008 by 
Paul and Silverstein [29J for large separable covariance matrices. 



In 2005, Haagerup and Thorbj0rnsen |19| have shown (1.1) using operator algebra techniques for ma- 
trices Hn = P{X[^\...,X^^^), where P is a polynomial in p non commutative indeterminates and 
x[^\ . . . , Xp^^ are independent, normalized N x N GUE matrices. This constitutes a real breakthrough 
in the context of free probability. Their method has been used by Schultz |3T| to obtain the same result 
for Gaussian random matrices with real or symplectic entries, and by Capitaine and Donati-Martin [TU] 
for Wigner matrices with symmetric distribution of the entries satisfying a Poincare inequality and for 
Wishart matrices. 



A consequence of the main result of the present article is that the phenomenon (1.1) holds in the setting 
considered by Voiculescu, i.e. for certain Hermitian matrices of the form Hn = P(XAr, Y^v, Y^). 

Theorem 1.1 (The spectrum of large Hermitian random matrices). Let X^r = {x[^\ . . . , Xp^'') be 
a family of independent, normalized GUE matrices and Y^r = (Yj'^\ . . . ^Yq'^'^) be a family of N x N 
matrices, possibly random but independent o/Xjy. Assume that for every Hermitian matrix H^ of the 
form 

Hn = PO^ Ni^*n)i 

where P is a polynomial in 2q non commutative indeterminates, we have with probability one that: 

L Convergence of the empirical eigenvalue distribution: there exists a compactly supported 
measure /i on the real line such that the empirical eigenvalue distribution of H^ converges weakly 
to fx as N goes to infinity. 
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2. Convergence of the spectrum: for any e > 0, almost surely there exists Nq such that for all 
N^No, 

Sp( iJw ) C Supp ( /i ) +(-£,£). (1.2) 

Then almost surely the convergences of the empirical eigenvalue distribution and of the spectrum also hold 
for all Hermitian matrices Hj\j = P(Xjv, Yjv, Y^), where P is a polynomial in p + 2q non commutative 
indeterminates. 

Theorem |l.l| is a straightforward consequence of Theorem |1.6| below, where the language of free probabihty 
is used. Moreover, Theorem 1 1 . 6| specifies Theorem |1.1| by giving a description of the hmit of the empirical 
eigenvalue distribution. For readers convenience, we recall some definitions (see [28 and [Ij for details). 

Definition 1.2. 1. A * -probability space (A, ■*,t) consists of a unital C-algebra A endowed with an 
antilinear involution .* such that {ab)* = b*a* for all a, b in A, and a state t. A state t is a linear 
functional t : A ^-^ C satisfying 

t[1] = 1, T[a*a] > Va e A (1.3) 

The elements of A are called non commutative random variables. We will always assume that t is 
a trace, i.e. that it satisfies T[ab] = r[&a] for every a,b Cz A. The trace t is said to be faithful when 
it satisfies r[a*a] = only if a — 0. 

2. The non commutative law of a family a = (ai,...,ap) of non commutative random variables is 
defined as the linear functional P i— > r[P(a, a*) ], defined on the set of polynomials in 2p non 
commutative indeterminates. The convergence in law is the pointwise convergence relative to this 
functional. 

3. The families of non commutative random variables ai, . . . , a„ are said to be free if for all K in N, 
for all non commutative polynomials Pi, ... , Pk 

r[Pi(a,;,,a*J...PK(a,,,a*^) ] -0 (1.4) 

as soon as ii ^ i2 ^ . . ■ ^ ik O'^d r [Pfe(ai^ , a*^) ] = for k = 1, . . . , K . 

4-. A family of non commutative random variables x = (xi, . . . , Xp) is called a free semicircular system 
when the non commutative random variables are free, selfadjoint (xi = x* , i = 1, . . . ,p), and for 
all k in N and i — 1, . . . ,p, one has 



-[x^] - J t'^dait), (1.5) 



with da{t) = ^'\/4 — -'-|tK2 dt the semicircle distribution. 
Recall first the statement of Voiculescu's asymptotic freeness theorem. 

Theorem 1.3 ( [2lJ[35ll38ll39] The asymptotic freeness of x[^\ X^^\Ym). Let Xn = ix['^\ • ■ • , X^^^) 
be a family of independent, normalized G UE matrices and Y^r = {Y^^\ . . . ,Yq^^) be a family of N x N 
matrices, possibly random but independent o/X^r. Let x = {xi, . . . , Xp) be a free semicircular system in a 
* -probability space (A, .*, r) and y = (j/i, . . . , yq) in A"^ be a family of non commutative random variables 
free from x. Assume the following. 

L Convergence of Y^r: Almost surely, the non commutative law ofy^ in (MAr(C), .*,tjv) converges 
to the non commutative law of y, which means that for all polynomial P in 2q non commutative 
indeterminates, one has 

T^[P(Y^,Y^)] ^ T[P(y,y*)], (1.6) 
where rjy denotes the normalized trace of N x N matrices. 
2. Boundedness of the spectrum: Almost surely, for j — 1, . . . , q one has 



r{N) 

iliii o up 1 1 J 

where \\ ■ \\ denotes the operator norm 



limsup llrV^l < oo, (1.7) 



1 INTRODUCTION AND STATEMENT OF RESULT 



4 



Then the non commutative law of (X.^ ^Y in (M7v(C), .*, r^v) converges to the non commutative law 
o/(x,y), i.e. for all polynomial P in p + 2q non commutative indeterminates, one has 

rjv[P(X^,Y^,Y^)] r[P(x,y,y*)]. (1.8) 

A* — fcjo 

In fl9' Haagerup and Thorbj0rnsen strengthened the connection between random matrices and free 
probabiHty. Limits of random matrices have now to be seen in more elaborated structure, called C*- 
probability space, which is endowed with a norm. 

Definition 1.4. A C* -probability space {A,.*,t,\\ ■ \\) consists of a * -probability space {A,.*,t) and a 
norm \\ ■ \\ such that {A, .*, || • |j) is a C* -algebra. 

By the Gelfand-Naimark-Segal construction, one can always realize ^ as a norm-closed C*-subalgebra 
of the algebra of bounded operators on a Hilbert space. Hence we can use functional calculus on A. 
Moreover, if r is a faithful trace, then the norm || • || is uniquely determined by the following formula (see 
\28\ Proposition 3.17]): 

||a|| = lim ( t\ (a*a)'^ 1 )^,Vae A (1.9) 
The main result of [TFJ is the following. 

Theorem 1.5 ( [19J The strong asymptotic freeness of independent GUE matrices). Let x[^\ . . . , xj/^'' 
be independent, normalized N x N GUE matrices and let xi, . . . ,Xp be a free semicircular system in a 
C* -probability space {A, .*, r, || • ||) with a faithful trace. Then almost surely, one has: for all polynomials 
P in p non commutative indeterminates, one has 

||P(xW,...,Xf))|| |lP(:.i,...,a:,)||. (1.10) 

This article is mainly devoted to the following theorem which is a generalization of Theorem |1.5| in the 
setting of Theorem |1.3[ 



Theorem 1.6 (The strong asymptotic freeness of x[^\ . . . , Yjv). Let Xjv = {x[^\ . . . , xjj^^) be 

a family of independent, normalized GUE matrices and Yjy = (y/^\ . . . , yj^^) be a family of N x N 
matrices, possibly random but independent o/Xat. Let h ~ (xi, . . . , Xp) and y = {yi, . . . ,yq) be a family 
of non commutative random variables in a C* -probability space {A,.*,t,\\ ■ ||) with a faithful trace, such 
that yi is a free semicircular system free from y. Assume the following. 

Strong convergence of Yjy: Almost surely, for all polynomials P in 2q non commutative indetermi- 
nates, one has 

tn[P{Yn,Y*^)] r[P(y,y*)], (1.11) 

||p(Ya.,y^)|| ^ l|P(y,y*)l|. (1.12) 

Then, almost surely, for all polynomials P in p ^ 2q non commutative indeterminates, one has 

rjv[P(XAr,YAr,Y;,)] ^ T [P(x, y , y* )] , (1.13) 
||P(Xjv,Yjv,Y^)|| ||P(x,y,y*)||. (1.14) 



The convergence of the normalized traces stated in (1.131 is the content of Voiculescu's asymptotic free- 



ness theorem and is recalled in order to give a coherent and complete statement. Theorem |1.1| is easily 



deduced from Theorem 1.6 by applying Hamburger's theorem |20| for the convergence of the measure 



and functional calculus for the convergence of the spectrum. 

Organization of the paper: In Section [2] we give applications of Theorem |1.6| which are proved in 
Section [9] Sections |3] to [8] are dedicated to the proof of Theorem |1.6[ 
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2 Applications 
2.1 Diagonal matrices 

The first and the simpler matrix model that may be investigated to play the role of matrices Yat in 
Theorem |1.6| consists of deterministic diagonal matrices with real entries and prescribed asymptotic 
spectral measure. 

Corollary 2.1 (diagonal matrices). Let X^r = {x[^\ . . . , Xp^^) be a family of independent, normalized 
GUE matrices and lefD^ = {d[^\ . . . , Dq^^) be N x N deterministic real diagonal matrices, such that 
for any j ^l,...,q, 

L the empirical spectral distribution of Dj^"^ converges weakly to a compactly supported probability 
measure fij, 

2. the diagonal entries of D^^^ are non decreasing: 

diag(Ar'(,),...,AW(,)), wUhx[^\j)^...^X^,-\j), 

3. for all £ > 0, there exists Nq such that for all N ^ A'o, for all j = 1 . . . q, 

Sp(£)f))c Supp(/i, ) + (-£,£). 

Let V = (z'l, . . . , Vq) in [0, 1]'. We set D]^ — (^d[^\vi), . . . , Dq^\vq)') , where for any j = 1, . . . ,q, one 
has 

= diag (a^^I^^.^j (j), A^L^^jYj (j) ) , with indices modulo N. 

Letx — {xi, . . . ,Xp) and d" — (^di{v), . . . ,c?g(w)) be non commutative random variables in a C* -probability 
space (A, .*, T, II 'ID with a faithful trace, such that 

L Ti is a free semicircular system, free from d", 

2. The variables di{v) , . . . , dq{v) commute, are self adjoint and for all polynomials P in q indetermi- 
nates, one has 

T[P{d-)]=J^ p(^F,-\u + v,),...,F-\u + Vq)yu. (2.1) 

For any j = l...q, the application F^^ is the generalized inverse of the cumulative distribution 
function Fj :t^ /i^ ( ] — oo,<]) of defined by: F^^ is 1-periodic and for all u in ]0, 1], F^^{u) — 
mi{t e M I Fj{t) ^ u}. 

Then, with probability one, for all polynomials P in p -\- q non commutative indeterminates, one has 

T^[P(X^,D]V)] T[P(x,d'')] (2.2) 

||P(Xa.,D]V)|| ||P(x,d'')||, (2.3) 

for any v in [0, 1]^ except in a countable set. 

Remark that the non commutative random variables di, . . . , can be realized as classical random vari- 
ables, dj being /^j -distributed for j — 1, . . . ,q. The dependence between the random variables is trivial 



since Formula (2.11 exhibits a deterministic coupling. 



The convergence of the normalized trace (2.2 1 actually holds for any v. In general, the convergence (2.3 1 
of the norm can fail: the family of matrices D = {d[^\ I?2^'') where 

d[^^ = diag (0LAr/2j , lAr_LAf/2j)) -DJ^'' = diag (0LAr/2j+i, lAr_[7V/2j-l) 

gives a counterexample (consider their difference). Furthermore, let mention that it is clear that we 
always can take one of the Vi to be zero. 
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2.2 Non- white Wishart matrices 

Theorem 1 1 . 6| may be used to deduce the same result for some Wishart matrices as for the GUE matrices. 
Let r, si, . . . , Sp ^ 1 be integers. Let Tin = {z[^\ . . . , Zp^'^) be a family of independent positive definite 
Hermitian random matrices such that for j = the matrix .^j^' is of size SjN x SjN. Let 

Wat = WAr(Z) = {w[^\ . . . , VFp^'') be the family of rN x rN matrices defined by: for each j — 1, . . . ,p, 
Pl/j^' = Af Z,-^-* M.-^-**. where Af,-^'' is a riV x SjN matrix whose entries are random variables, 

and the random variables (v^Re (Afn^m), %/2Im {Mn^„-,) )i^n^rN,i^m^sjN form a centered Gaussian 
vector with covariance matrix :^'i-2rsjN^- We assume that A//f\...,Aff \ Z^r are independent. The 
matrices Wi'^\ . . . ^Wp^'' are called non-white Wishart matrices, the white case occurring when the 
matrices Zj^^ are the identity matrices. 

Corollary 2.2 (Wishart matrices). Let Yn = (^i^^', • • ■ , Yq ^"^) be a family of rN x rN random matri- 
ces, independent o/Z^v andW^. Assume that the families of matrices (Z[^^), . . . , {Zq^^),Y n satisfy 
separately the assumptions of Theorem \1.6\ Then, almost surely, for all polynomials P in p + 2q non 
commutative indeterminates, one has 

||P(W^,Y^,Y^)|| ^ |lP(w,y,y*)||, (2.4) 



where \\ ■ \\ is given by Formula ( |1.9| with r a faithful trace for which the non commutative random 
variables w ~ {wi, . . . , Wp) and y = (j/i, . . . , yq) are free. 

In |29j , motivated by applications in statistics and wireless communications, the authors study the global 
limiting behavior of the spectrum of the following matrix, referred as separable covariance matrix: 



where X„ is a n x m random matrix, aI/^ is a nonnegative definite square root of the nonnegative definite 
n X n Hermitian matrix A„ and Bn is a m x to diagonal matrix with nonnegative diagonal entries. It is 
shown in that, for n large enough, almost surely the eigenvalues of C„ belong in a small neighborhood 
of the limiting distribution under the following assumptions: 

1. TO = m{n) with c„ := n/m — > c > 0. 

2. The entries of X„ are independent, identically distributed, standardized complex and with a finite 
fourth moment. 

3. The empirical eigenvalue distribution Ca„ (respectively Cb„) of A„ (respectively Bn) converges 
weakly to a compactly supported probability measure Va (respectively vt) and the operator norms 
of An and Bn are uniformly bounded. 

4. By assumptions 1,2 and 3, it is known that almost surely Cc„ converges weakly to a probability 

measure fJ-[^].ub- This define a map $ : (x, 1/1,1^2) '-^ t^v^uui (the input x is a positive real number, 
the inputs vi and V2 are probability measures on M"*"). Assume that for every e > 0, there exists 
no ^ 1 such that, for all n ^ no, one has 

Supp ( M£:\£,„ ) C Supp ( ) + (-£,£). 



Now consider the following situation, where Corollary [2T2] may be applied 
V n = n{N) — rN, to — m{N) — sN for fixed positive integers r and s, 

2' the entries of Xn are independent, identically distributed, standardized complex Gaussian, 
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3' the empirical eigenvalue distribution of An (respectively _B„) converges weakly to a compactly 
supported probability measure, 

4' for N large enough, the eigenvalues of An (respectively Bn) belong in a small neighborhood of its 
limiting distribution. 

Then we obtain by Corollary |2.2| that for N large enough, almost surely the eigenvalues of C„ belong in 
a small neighborhood of the limiting distribution. The advantage of our version is the replacement of 
assumption 4 by assumption 4'. Replacing assumptions 1' and 2' by assumptions 1 and 2 could be an 
interesting question. 



2.3 Block matrices 



It will be shown as a consequence of Theorem 1.6 that the convergence of norms (1.14) also holds for 
block matrices. 



Corollary 2.3 (Block matrices). Let Xjv,Yjv,x, y and t be as in Theorem 1.6 Almost surely, for 
all positive integer i and for all non commutative polynomials {Pu,v)i!^u.v!i£, the operator norm of the 
iN X £N block matrix 



converges to the norm 



\ A,l(XAr, Yjv, Y^) 
Te(^T of 

/ Pi,i(x,y,y*) 



-Pi ,f (Xjv , Yjv , Y^ ) 



(2.5) 



V Pii(x,y,y*) ... 
where \\ ■ WtiiSjt is given by the faithful trace Tf ® t defined by 

Pia(x,y,y*) ... Pi,,(x,y,y*) 




(2. 



in ® t) 



A,i(x,y,y*) ... Pij{x,y,y*) 



•[i^P,,,;(x,y,y*) 



2.4 Channel matrices 

We give a potential application of Theorem |1.6| in the context of communication, where rectangular block 
random matrices are sometimes investigated for the study of wireless Multiple-input Multiple-Output 
(MIMO) systems |25| [36] . In the case of Intersymbol-Interference, the channel matrix H reflects the 
channel effect during a transmission and is of the form 



H 



/ Ai A2 ... Al ... 
Ai A2 ... Al 
: Ai A2 ... Al 



\ 



V 







Al A2 





Al ) 



(2.7) 



(^/)i^f^L are x nq^ matrices that are very often modeled by random matrices e.g. Ai, . . . , are 
independent and for £ = 1, . . . , L the entries of the matrix Ag are independent identically distributed with 
finite variance. The number of matrices L is the length of the impulse response of the channel, ut is the 
number of transmitter antennas and n^j is the number of receiver antennas. 

In order to calculate the capacity of such a channel, one must know the singular value distribution of 
iJ, which is predicted by free probability theory. Theorem |1 .6| may be used to obtain the convergence of 
the singular spectrum for a large class of such matrices. For instance we investigate in Section [973] the 
following case: 
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Corollary 2.4 (Rectangular band matrices). Let r and t be integers. Consider a matrix H of the form 
{2.1) such that for any t — 1, . . . , L one has — CiAIgDi where 

1. M = {Ml, . . . , Ml) is a family of independent rN x tN random matrices such that for £ — 1, . . . , L 
the entries of Mi are independent, Gaussian and centered with variance a'j /N , 

2. the family of rN x rN matrices C = (Ci, . . . ,Ci) and the family of tN x tN matrices D = 
{Di, . . . , Dl) satisfy separately the assumptions of Theorem 1.6 , 

3. the families of matrices M, C and D are independent. 

Then, almost surely, the empirical eigenvalue distribution of HH* converges weakly to a measure fi. 
Moreover, for any e > 0, almost surely there exists Nq such that the singular values of H belong to 
Supp(^) + (-e,e). 



3 The strategy of proof 



Let X 



N 



(N) 



X^^') and Y_ 



N 



(N) 



be as in Theorem 



1.6 



We start with some 



remarks in order to simplify the proof. 



1. We can suppose that the matrices of Y^v are Hermitian. Indeed for any j = one has 



) = Re yp 



i Im Yj^\ where 



Re y 



(N) 



(N) 



Y„ 



Im y 



(N) 



(N) 



y 



(N)* 



are Hermitian matrices. A polynomial in (Yjv,Y^) is obviously a polynomial in the family 
(Re Y^ , . . . , Re Yq^\lTa. Y^^\ . . . , Im Yq^^) and so the latter satisfies the assumptions of Theo- 



Rey,^^\imy; 

rem|1.6|as soon as Y^r does. 



It is sufficient to prove the theorem for deterministic matrices Ytv. Indeed, the matrices Xjv and 
Y^v are independent. Then we can choose the underlying probability space to be of the form 
il. — rti X ^2, with Xjv (respectively Yjv) a i neasu rable funct ion on ili (respectively 512). The 
event "for all polynomials P the convergences (1.13) and (1.14) hold" is a measurable set 17 C fl. 



Assume that the theorem holds for deterministic matrices. Then for almost all uj2 & fl2, there exists 
a set (Ii{ll!2) for which for all uji G Cti, (1.13) and (1.14) hold for (X7v(aji), Y7v(w2)). The set of 



such couples {u)i,lu2) is of outer measure one and is contained in Q, hence by Fubini's theorem D, is 
of measure one. 



3. It is sufficient to prove that for any polynomial the convergence of the norm in (1.14) holds almost 



surely (instead of almost surely the convergence holds for all polynomials). Indeed we can switch 
the words "for all polynomials with rational coefficients" and "almost surely" and both the left and 



the right hand side in (1.14) are continuous in P 



In the following, when we say that Yn = {Y^^\ . . . , Yq'^'^) is as in Section [3] we mean that Yat is a 
family of deterministic Hermitian matrices satisfying ( |1.11[ ) and (1.12). 



Remark that by (|1.12|, almost surely the supremum over N of is finite for all j — l,...,g. 



Hence by Theorem |1.3[ with probability one the non commutative law of (Xat, Y^r) in (M7v(C), .*,tjv) 
converges to the law of non commutative random variables (x, y) in a *-probability space (^, .*,t, ): 
almost surely, for all polynomials P in p + q non commutative indeterminates, one has 



tn[P{Xn,Yn) ] 

where the trace r is completely defined by: 

• X = {xi, . . . , Xp) is a free semicircular system, 



N- 



-[^(x,y)], 



(3.1) 



• y — (j/i, . . . , yq) is the limit in law of Yjv, 
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• X, y are free. 

Since t is faithful on the *-algebra spanned by x and y, we can always assume that r is a faithful trace 
on A. Moreover, the matrices Yjv are uniformly bounded in operator norm. If we define |j • || in by 



Formula ( 1.9 1, then \\yj\\ is finite for every j = 1, . . . , q. Hence, we can assume that A is a, C*-probability 



space endowed with the norm || • ||. 

Haagerup and Thorbj0rnsen describe in [19 a method to show that for all non commutative polyno- 
mials P. almost surely one has 

||P(X^)|| ||P(x)||. (3.2) 

We present in this section this method with some modification to fit our situation. First, it is easy to see 
the following. 

Proposition 3.1. For all non commutative polynomials P , almost surely one has 

liminf ||P(X^,Yw,Y^)|| ^ ||F(x, y, y*)||. (3.3) 

Proof. In a C*-algebra {A, .*, || • ||), one has Va e A. ||a|p = Hence, without loss of generality, we 

can suppose that '■= P(X.n n '^on negative Hermitian and h :— P(x,y,y*) is selfadjoint. 
Let Cn denote the empirical spectral distribution of Hpf-. 

1 ^ 

i=l 



where Ai,...,Ajv denote the eigenvalues of and 5\ the Dirac measure in A £ M. By (3.11 and 
Hamburger's theorem [20 , almost surely Cj^ converges weakly to the compactly supported probability 
measure /i on M given by: for all polynomial P, 



j Pd^ = T[P{h)]. 



Since t is faithful, the extrema of the support of ^ is ([28, proposition 3.15]). In particular, if 
/ : M — M is a non negative continuous function whose support is the closure of a neighborhood of \\h\\ 
(/ not indentically zero), then almost surely there exists a A^o ^ such that for all N ^ Nq one has 
^N{f) > 0. Hence for N ^ Nq some eigenvalues of Hn belong to the considered neighborhood of \\h\\ 
and so \\Hn\\ ^ \\h\\. □ 



It remains to show that the limsup is smaller than the right hand side in (3.3 1. The method is carried 
out in many steps. 



Step 1. A linearization trick: With inequality (3.3 1 established, the question of almost sure convergence 



of the norm of any polynomial in the considered random matrices can be reduced to the question of the 
convergence of the spectrum of any matrix-valued selfadjoint degree one polynomials in these matrices. 



More precisely, in order to get (3.2 1, it is sufficient to show that for all e > 0, k positive integer, L 
selfadjoint degree one polynomial with coefficients in Mfe(C), almost surely there exists Nq such that for 
all N ^ No, 

Sp( L(Xw,Y^,Y;,) ) C Sp( L(x,y,y*) ) + (-£,£). (3.4) 

We refer the readers to fTW, Parts 2 and 7] for the proof of this step, which is based on C*-algebra and 
operator space techniques. We only recall here the main ingredients. By an argument of ultraproduct it 
is sufficient to show the following: Let (x, y) be elements of a C*-algebra. Assume that for all selfadjoint 
degree one polynomials L with coefficients in Mfe(C), one has 

Sp(L(i,y,r)) cSp(i(x,y,y*) ). (3.5) 

Then for all polynomials P one has ||P(x, y, y*)|| ^ ||P(x, y, y*)||. The linearization trick used to prove 
that fact arises from matrix manipulations and Arveson's theorem: with a dilation argument, one deduces 



from (3.5) that there exists (f> a unital *-homomorphism between the C*-algebra spanned by (x,y) and 
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the one spanned by (x,y) such that one has (l>{xi) = i; for z = 1, 
A *-homomorphism being always contractive, one gets the result. 



,p, and (j){yi) = for i = 1, 



We fix a selfadjoint degree one polynomial L with coefficients in Mfe(C). To prove (3.4| we apply the 
method of Stieltjes transforms. We use an idea from Bai and Silverstein in [5j: we do not compare the 
Stieltjes transform of i(Xjv,Yjv) with the one of _L(x,y). but with an intermediate quantity, where in 
some sense we have taken partially the limit N goes to infinity, only for the GUE matrices. To make 
it precise, we realize the non commutative random variables (x, y, (YAr)7v^i) in a same C* -probability 
space {A, •*,t, || • ||) with faithful trace, where 

• the families x, y, Yi, Y2, . . . , Yat, . . . are free, 

• for any polynomials P in q non commutative indeterminates t[P(Yjv)] tn[P(Y n)]. 

The intermediate object L(x, Yjy) is therefore well defined as an element of A. We use a theorem about 
norm convergence, due to D. Shlyakhtenko and stated in Appendix [A| to relate the spectrum of i(x, Yjv) 
with the spectrum of i(x, y). 

Step 2. An intermediate inclusion of spectrum: for all e > there exists Nq such that for all 
N ^ A'o, one has 

Sp(L(x,Yjv)) cSp(L(x,y)) + (-e,e). (3.6) 



We define the Stieltjes transforms ^^nd of = L(Xjv, Yat) and respectively 
the formulas 



5l«(A) 



E 



(Tfe (g) t) 



i(x,Y„) y' 



L{^,Yn) by 

(3.7) 
(3.8) 



for all complex numbers A such that Im A > 0. 



Step 3. Prom Stieltjes transform to spectra: In order to show (3.5) with (3.6) granted, it is 
sufficient to show the following: for every e > 0, there exist Nq, 7, c, a > such that for all N ^ A^o, for 
all X in C such that e ^ (Im A)^"'^ ^ , one has 



lffL«(A)-g£„(A)| ^(Im A)-". 



(3.9) 



The proof of Estimate (3.9) represents the main work of this paper. For this task we consider a gener- 
alization of the Stieltjes transform. We define the Mfc(C)-valued Stieltjes transforms Gi„ and Gf„ of 
Ltv = -^(X^r, Y^v) and respectively £n — -^(x, Yjv) by the formulas 



GlJA) 
GiJA) 



E 



{idk '»tn) (A(g) Iat - L(XAr, Y 



N 



(idfe«)T) (A® 1 - i(x, Yat) ) ^ 



(3.10) 
(3.11) 



for all fc X fc matrices A such that the Hermitian matrix Im A := (A — A*)/ {2i) is positive definite. Since 
9Ln{X) = Tk[GL„{Xlk)] and 5f„(A) = Tfe[G^„(Alfe)], a uniform control of ||Gl„(A) - G^„(A)|| will be 
sufficient to show (|3.9|). Here || • || denotes the operator norm. 



Due to the block structure of the matrices under consideration, these quantities are more relevant than 
the classical Stieltjes transforms. The polynomial L is selfadjoint and of degree one, so we can write 
Ln = ao (S) In + Sn + Tjv, £n = ao <E) 1 + s + T/y, where 



5jv = ^ aj (E) X 



(N) 



) Xj, Ti 



N 



(N) 



and qq, . . . , ap,bi, . . . ,bq are Hermitian matrices in Mfc(C). We also need to introduce the M^;(C)-valued 
Stieltjes transforms Gtjv of T/y: 



Gt„ (A) = (idfc tat) (a ® 1 - Tat 



(3.12) 
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for all A in Mfe(C) such that Im A is positive definite. 

The families x and being free in A and x being a free semicircular system, the theory of matrix-valued 
non commutative random variables gives us the following equation relating and Gtjv • It encodes the 
fundamental property of 7?.-transforms, namely the linearity under free convolution. 

Step 4. The subordination property for Mfe(C)-valued non commutative random variables: 

For all A in Mfc(C) such that Im A is positive definite, one has 

G,„(A) = GT„(A-ao-7^.(G,„(A) ) ), (3.13) 



where 



We show that the fixed point equation implicitly given by (3.131 is, in a certain sense, stable under 



perturbations. On the other hand, by the asymptotic freeness of X^y and Y^y, it is expected that 



Equation (3.131 is asymptotically satisfied when Gi^ is replace by Gl^- Since, in order to apply Step 3, 



we want an uniform control, we make this connection precise by showing the following: 

Step 5. The asymptotic subordination property for random matrices: For all A in Mfe(C) such 
that Im A is positive definite, one has 

GL„(A) = GT„(A-ao-7e.(GL„(A) ) ) +eAr(A), (3.14) 

where 07v(A) satisfies 

\\^NiA)\\ ^ ^||(ImA)-if 

for a constant c and with \\ ■ \\ denoting the operator norm. 
Organization of the proof 

We tackle the different points of the proof described above in the following order: 

• Proof of Step 4. The precise statement of the subordination property for (C)-valued non 



commutative random variables is contained in Proposition 4.2 and Proposition |4.3| We highlight 



in this section the relevance of matrix-valued Stieltjes transforms in a quite general framework. 

Proof of Step 5. The asymptotic subordination property for random matrices is stated in Theorem 
|5.1| in a more general situation. The matrices Y^v can be random, independent of Xjy, satisfying 
a Poincare inequality, without assumption on their asymptotic properties. This result is based on 
the Schwinger-Dyson equation and on the Poincare inequality satisfied by the law of X^r. 



Proof of Estimate (3.9). The estimate will follow easily from the two previous items. 



Proof of Step 2. This part is based on C*-algebra techniques. Step 2 is a consequence of a 
result due to D. Shlyakhtenko which is stated Theorem |A.l| of Appendix]^ In a previous version of 
this article, when we did not know this result, we used the subordination property with L(x, Yjy) 
replaced by L(x,y) and Tjy replaced by its limit in law t — X)J=i ^ Vj- Hence we obtained 
Theorem 1 1 .6| with additional assumptions on Yjy, notably a uniform rate of convergence of Gt„ to 
the Mfc(C)-valued Stieltjes transform of t. 



• Proof of Step 3. The method is quite standard once Steps 2 and 4 are established. We use a 
version due to |T8J which is based on the use of local concentration inequalities. 
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4 Proof of Step 4: the subordination property for matrix- valued 
non commutative random variables 

In random matrix theory, a classical method lies in the study of empirical eigenvalue distribution by the 
analysis of its Stieltjes transform. In many situation, it is shown that this functional satisfies a fixed 
point equation and a lot of properties of the considered random matrices are deduced from this fact. The 
purpose of this section is to emphasize that this method can be generalized in the case where the matrices 
have a macroscopic block structure. 



Let {A, ■*,T, II • II) be a C* -probability space with a faithful trace and fc > 1 an integer. The algebra 
Mfc(C) (8) A, formed by the k x k matrices with coefficients in A, inherits the structure of C* -probability 
space with trace (r^ (g) r) and norm || • \\rk(ST defined by (1.9 1 with ® t instead of r. We also shall 
consider the linear functional (idfe ® r), called the partial trace. 

For any matrix A in Mfe(C) we denote Im A the Hermitian matrix ^(A — A*). We write Im A > 
whenever the matrix Im A is positive definite and we denote 

Mfc(C)+ = {A e Mfe(C) I Im A > O}. 

This lemma will be used throughout this paper. See |19| Lemma 3.1] for a proof. 

Lemma 4.1. Let z in Mfe(C) ® A he selfadjoint. Then for any A G Mfe(C)+, the element (A (g) 1 — z) is 
invertible and 

\\iA®l~z)-\^^^^\\{lmA)-'\\. (4.1) 
On the right hand side, || • || denotes the operator norm in Mk{C). 

For a selfadjoint non commutative random variable z in Mfc(C) (>^A, its Mfc(C)-valued Stieltjes transform 
is defined by 

: Mk(C}+ ^ Mfc(C) 

A ^ (idfe «)t) (a® 1 - z)-i 



The functional G^ is well defined by Lemma |4.1| and satifies 

VAeMfe(C)+, ||G,(A)|| ||(Im A)-i||. 

It maps Mfc(C)+ to Mfc(C)" = ^ Mfc(C) | - A e Mfe(C)+} and is analytic (in P complex variables 
on the open set Mfe(C)"'" C C'' ). Moreover, it can be shown (see |3S]) that Gz is univalent on a set of 
the form JJa = {A G Mfe(C)+ | ||A^-'^|| < (5 } for some S > 0, and its inverse gI in Us is analytic on a 
set of the form V-y ^ {A <E Mfe(C)" | || A|| < 7} for some 7 > 0. 

The amalgamated 7?.-transform over Mfe(C) of z G Mfe(C) ^ is the function TZ^ ■ G^iUs) Mfe(C) 
given by 

7^,(A) = G^l)(A)-A-^ VAgG,(;75). 

The following proposition states the fundamental property of the amalgamated 7?,-transform, namely the 
subordination property, which is the keystone of our proof of Theorem |1.6| 



Proposition 4.2. Let x = (xi, . . . ,Xp) and y — (yi, . . . ,yq) he selfadjoint elements of A and let a = 
(oi, . . . , flp) and h — (61, ... , hq) be k x k Hermitian matrices. Define the elements o/Mfe(C) A 

p 9 
s = ttj (g) Xj, t — bj ® yj . 

Suppose that the families x and y are free. Then one has 

1. Linearity property: There is a ^ such that, in the domain V^, one has 

TZs+t^Tls+Tlt. (4.2) 
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2. Subordination property: There is S such that, for every A in Us, one has 

3. Semicircular case: // (xi, . . . ,Xp) is a free semicircular system, then we get 

V 

TZs '■ A I— > GjAaj. 



(4.3) 



(4.4) 



Proof. The linearity property has been shown by Voiculescu in [38] and the 7?.-transforni of s has been 
computed by Lehner in [26 . We deduce easily the subordination property since by Equation (4.2): there 
exists 7 > such that for all A e V^, 

Then there exists a 6 > such that, with Gs+t{A) instead of A in the previous equality 

G\-'\G,+t{A) ) = A-7^,(G,+t(A) ). 



We compose by g[ to obtain the result. 



□ 



The subordination property plays a key role in our problem: it describes Gs+t as a fixed point of a simple 
function involving s and t separately. Such a fixed point is unique and stable under some perturbation, 
as it is stated in Proposition 4.3 below. Remark first that, for TZg given by (4.4|. for any A in Mfe(C)+ 
and M in Mfe(C)-, 



Im (A - UsiM) ) = Im A - ^ Im M aj > 



and 



(im {A-Hs{M) ) ) ^ II (Im A)-i|l. 



(4.5) 



(4.6) 



In particular, by analytic continuation, the subordination property holds actually for any A £ Mfc(C)+ 
when X is a free semicircular system. 



Proposition 4.3. Let s and t he as in Proposition \4-S\ with x a free semicircular system. 
1. Uniqueness of the fixed point: For all A G Mfe(C)+ such that 



II (Im A)-i|| < 
the following equation in Ga G Mfe(C)~, 



\ 



Ell" 



2 

J II ' 



GA = Gt(A-7^,(G^ )' 
admits a unique solution Ga in Mk(C)^ given by Ga = Gs+t{A). 



(4.7) 



2. Stability under analytic perturbations: Let G : ft ^ Mfc(C)^ be an analytic function on a 
simply connected open subset fl C Mfe(C)^ containing matrices A such that ||(Im A)^^|| is arbitrary 
small. Suppose that G satisfies: for all A G fi, 



G(A) = Gt(A-7^,(G(A) ) ) +e(A), 



(4. 



where the function Q : Mfc(C) is analytic and satisfies: there exists £ > such that for all A 

in fl, 

^(A) := |ie(A)|l |l(ImA)-i|l |la,f < 1 - e. 
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Then one has: VA G Q 



|G(A)-G.+,(A)|| (1 + c ||(Im A)-if ) |ie(A)||, 



(4.9) 



where c = j J2'j=i llojlP- 

Proof. 1. Uniqueness of the fixed point: 
Fix A e Mfc(C)+ such that 



|(Im K)-H < 



(4.10) 



Denote for any M in Mfc(C)" the matrix ip{M) = A - 7^s(M), which is in Mfc( 
that the function 

$A:A/^Gt(^(M)) 



by (4.5 1. We show 



is a contraction on Mfc(C) . Remark that $a maps Mfc(C) into Mfc(C) . Moreover for all M,M in 

Mfe(C)-, 



||$A(M)-$A(Af)|l 



(idfc ® r) 
(idfe (g) t) 



(V(M) ® 1 - ^ - (tp{M) (g) 1 - 
(V(M)(»l-t) (^^aj{M - M)aj^ «) Ijv (V'(^) » 1 " ^) 



-1 -1 
(im (ipiM) (g) 1 - t)) (im (V'(AO 1 - i)) ^ ||aj|P ||M - M 



<||(lm A)-if ^||a,-|n|M-M||. 

Hence the function <i>A is a contraction and by Picard's theorem the fixed point equation M — <i>A(^^) 
admits a unique solution M\ on the closed set of fc x fc matrices whose imaginary part is non positive 
semi-definite, which is necessarily Gs+t by the subordination property. 

2. Stability under analytic perturbations: 

We set G : O ^ Mfc(C)" given by: for all A € fl, 

G(A) = G(A) - e(A) = Gt (a - TZs (G(A) ) ) . 

We set A : 17 Mfe(C) given by: for all A e 

A(A) = A-7^,(e(A)) = A-7^,(G(A) ) +7^,(G(A) ). 

In the following, we use A as a shortcut for A(A). One has A — 7?.s(G(A) ) = A — TZs{G{A) ) which is in 
Mfc(C)+ by (|4^. Hence we have: for all A e n, 



G(A) = Gt(A-7^,(G(A) ) ). 



(4.11) 



We want to estimate ||(Im A) ^|| in terms of ||(Im A) ^||. For all A in ft, we use the definition of A and 
we write: 

Im A Im A (ik - (Im Ay^TZs (e(A) ) ) . 

Remark that ||(Im A)-l7^s(e(A) )|| ^ k(A) = ||e(A)|| ||(Im A)-^\\ ^^^^ \\aj\\^ < 1 - e by assumption. 
Then Im A is invertible and one has 

(Im A)-i = ^ ( (Im A)-l7^,(e(A) ) ^ (Im A)-\ 
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We then obtain the following estimate 

||(Im A)-i|| s$ II ^ ( (Im A)-l7^,(e(A) ) ^ (Ini A)-i 



1 



l(ImA)-i|l<-||(ImAri|| 
1 — K[A) e 



By uniqueness of the fixed point and by (4.111, for all A G 17 such that ||(Ini A) ^|| < 11% 11^ 



one has G(A) = Gs+t(A) (such matrices A exist by assumption on Q). But the functions are analytic (in 
complex variables) so that the equality extends to Vl. Then for all A e fJ, 

||G(A)-G,+t(A)|| ^ ||G(A)-G(A)|| + ||G,+,(A)-G,+t(A)||. 

For the first term we have by definition of G that ||G(A) — G(A)|| ^ ||9(A)||. On the other hand, one has 

||G,+t(A)-G.+t(A)|| 

(idfe ® r) [(A 1 - s - t)-'^ - (A (g) 1 - s - t)-^ ] 

(idfc t)[(A«) 1 - s - ty^(k®l - A® 1)(A® 1 - s- t)~^ 
^ \\{K®1- s-t)-^\\ ||A-A|| ||(A® 

^ ||7^,(G(A) )-7^,(G(A) ) II ||(ImA)-i||2 

\ j^Wa.r ||(ImA)-if ||e(A)||. 



We then obtain as expected 

iiG(A) - G.+*(A)ii ^ (i + ; E ii«^n' 11(1"^ 



|0(A)|| 



□ 



5 Proof of Step 5: the asymptotic subordination property for 
random matrices 



The purpose of this section is to prove Theorem |5.1| below, where it is stated that, for N fixed, the 
matrix-valued Stieltjes transforms of certain random matrices satisfy an asymptotic subordination prop- 



erty i.e. an equation as in (4.8). This result is independent with the previous part and does not involve 



the language of free probability. 



Let Xjv = {x['^\ . . . ,Xp"') be a family of independent, normalized N x N matrices of the GUE and 
Yjv = {Y-l^'^\ . . . , Yq ^^) be a family of N x N random Hermitian matrices, independent of Xjv. We fix 
an integer fc ^ 1 and Hermitian matrices qq, . . . ,ap,bi, . . . ,bq e Mfc(C). We set Sn and T/v the kN x kN 
block matrices 



(N) 



Define the Mfc(C)-valued Stieltjes transforms of Sn + Tn and Tn: for all A e Mfc(C)+ = {A e 
Mfc(C) I Im A > 0}, 



G5jv+Tjv(A) 

Gt„(A) 



(idfc^Tjv) {A®1n~Sn-Tn) ^ 
{idk (g>TN)\{A(8> In -TNy^ 
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We denote by TZg the functional 



n,: Mfe(C)^ Mfe(C) 
p 

M ^ a J M aj. 

Theorem 5.1 (Asymptotic subordination property). Assume that there exists a ^ 1 such that the joint 
law of the entries of the matrices Yjv satisfies a Poincare inequality with constant cr/N, i.e. for any 

f : R^''^ — C function of the entries of q matrices, of class and such that E 

has 



< oo, one 



ar{ /(Y 



N) 



N 



|V/(Y^)|f 



(5.1) 



where V/ denotes the gradient of f , Yar denotes the variance, Var( a; ) = E[ | x — E[ x 
Then for any A G Mj.(C)^, the Stieltjes transforms Gs^+Tn '^^'^ satisfy 

G5„+T„(A) = GT„(A-7^,(Gs„+T„(A) ) ) + e^(A), 

where Q is analytic M^iC)'^ — >■ M/j(C) and satisfies 

\\^n{A)\\ < ^||(ImA)-if, 



(5.2) 



w^th c = 2k^/^aj:U H".' II' ( ^^=1 ll^^'H + H^^'H 
The proof of Theorem |5.1| is carried out in two steps. 



denoting the operator norm in Mfc(C). 



• In Section 5.1 we state a mean Schwinger-Dyson equation for random Stieltjes transforms (Propo- 
sition 



5.21. 



In Section |5.2| we deduce from Proposition |5.2| a Schwinger-Dyson equation for mean Stieltjes 



transforms (Proposition 5.3 1. 
Theorem |5.1| is a direct consequence of Proposition |5.3| as it is shown in Section |5.3 



5.1 Mean Schwinger-Dyson equation for random Stieltjes transforms 

For A,r in Mfc(C)+, define the elements of Mfc(C) <S) M^iC) 



^Siv+T„(A) 



(A(E)lN-SN-TNy\ 
{T <E, In - Tn)-\ 



and i7s„+T„(A) = (idfe (g) tn) /isn+Tjv(A) , Ht„{A) = {idk ® tn) ^Tjv(A) 

Proposition 5.2 (Mean Schwinger-Dyson equation for random Stieltjes transforms). For all A,r e 

Mfe(C)+ we have 



E 



H. 



s„+T„ (A) - Ht, (T) - (idfc tn) [hr, (P) (u, (i?5„+T„ (A) ) - 



A + P 01/v h 



(A) 



0. (5.3) 



The result is a consequence of integration by parts for Gaussian densities and of the formula for the 
differentiation of the inverse of a matrix. If (gi, . . . , qn) are independent identically distributed centered 
real Gaussian variables with variance and F : M.^ — > C a differentiable map such that F and its partial 
derivatives are polynomially bounded, one has for i = 1, . . . , N 



E 



9i Figi,...,gN) 



dF 
dxi 
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This induces an analogue formula for independent matrices of the GUE, called the Schwinger-Dyson 
equation, where the Hermitian symmetry of the matrices plays a key role. For instance, if P is a 
monomial in p non commutative indeterminates, one has for i — 1, . . . ,p, 



E 



TN 



= E E 

P=LxiR. 



TN 



L(XAr) TN Rpi.N) 



the sum over all decompositions P ~ LxiR for L and R monomials being viewed as the partial derivative. 

This formula has an analogue for analytical maps instead of polynomials. The case of the function 
Xjv (A (g) Itv — Sn)~^ is investigated in details in (THl Formula (3.9)], our proof is obtained by minor 
modifications. 



Proof. Denote by {em.n)m.n=i,....N the canonical basis of M7v(C). By [TS", Formula (3.9)] with minor 
modification, we get the following: for all A,r in Mfc(C)+ and j = 1,. . . ,p, 



E 



(Ife ® X\^^){A ®1n-Sn- TnY 



T 



N 



E 



r 1 



N 



— J2 (lfe®em,„)(A«)lAr-5'Ar-Tjv) ^ (o^- ® £„,„) (A ® l^v - ^Ar - Ta,) ^ 



m.n—l 



T 



N 



In these equations, E[-|r/v] stands for the conditional expectation with respect to Tn- Furthermore, for 
any M in Mfc(C) (g) Mn{C), one has 

1 ^ 

— ^ (Ife e„^„) M (Ife (g) e„,„) = (idfc (g) tn)[ M ] ® In- 



Indeed the formula is clear if M is of the form M = M (g e„ and extends by linearity. In particular, 
with M ^ (Ai^ In - Sn - TN)~^{aj (8) In), we obtain that: for all A,r in Mfe(C)+ and j = 1,. - . ,p, 



E 



(flj ® xl^^)iA® In - Sn -Tn)-^ 



T 



N 



(aj(g)lAr)( (idfc^Tjv) {A(E)1n - Sn - Tn) ^ 1 jv ) ( A (g) 1 



LAT — JN 



Tn)-' 



T 



N 



Recall that Sn = ELi % ® ^j^^ and Us : M ^ YTj=i ajMa^, so that for all A,r in Mfc(C)+, one has 



Tn 



E 



(r(E)lN- Tn)-' Sn (A ® 1^ - ^a, - Tn)-' 



E 



E 



E 



{T(glN-TN)-' ^E[(a, 0Xj^^) iA(g>lN -Sn-Tn)' 



T 



N 



r 

'(r) E[(E«J^s«+T„(A)aj Ijv) /is„+T„(A) 



T, 



AT 



/iT„(r) (7^,(i^5„+T„(A) /is„+t„(A) 



We take the partial trace in Equation (5.4 1 to obtain 



E 



{idk (^tn) /iT„(r) Sn /is„+t„(A) 



E 



(idfe(g)TA,) /iT„(r) (7^,(i^s„+T„(A) ) «) Iat) /is„+t„(A) 



(5.4) 



(5.5) 
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We now rewrite as follow 



5jv = (A - r) ® Iat + (r ® Ijv - Tat) - (A (8) Iat - S'jv - Tw). 



E 



Re-injecting this expression in the left hand side of Equation ( |5.5| , one gets Equation ( |5.3[ ) 

(idfe ® tat) [/lT„ (r) (Us (i/s„+T„ (A) ) ® Iat) hs^+T^ (A) 

= E (idfe <E)tn) ft.T„ (r) (A - r) (g) Ijv /iSjv+Tjv (A) + (A)-/iT„(r) 
= E (idfe ® rjv) f /iT„ (r) ((A - r) ® In) /i5«+t„ (A)! + i?s„+T« (A) - Ht^ (T) 



□ 



We use the concentration properties of the law of (Xtv, Yjv) to get from Equation ( |5.3| a relation between 
Gsjv+Tn Gtjv- We define the centered version of Hs^^Tn t>y: for all A in Mfc(C)+, 



5.2 Schwinger-Dyson equation for mean Stieltjes transforms 



Xs„+T„(A) = i/5«+T„(A) -Gs„+T„ (A), in Mfe(C). 
We introduce the random linear map 



/jv,A,r: Mk{C)(E>MN{ 
M 



^ Mfc(C)®MAr(C) 



(5.6) 



(5.7) 



and its mean 



(A/) 



(5. 



Remark that if M is a random matrix, then iAr.A_r(A/) = E[/ij.^ (F) Af hg^^f^ (A) | Af] , where (Sn+Tn) 
is an independent copy of (Sn + TV) independent of A/. 

Proposition 5.3 (Schwinger-Dyson equation for mean Stieltjes transforms). For all A,T in M/j(C) + , 
one has 



Gs„+T„ (A) - Gt„ (r) - (idfe (g) tat) 
where 



7^,(Gs„+T„(A))-A + ^)$5l 



0Af(A,r)— E (idfc(X)Tjv) ('Ar,A,r — Tjv,A,r )(7^,(/^5„+T„(A) )® 

is controlled in operator norm by the following estimate: 

\\eNiA,T)\\ < ^ ||(Im r)-i ||(Im A)"if (||(Im + \\{lm A)-' 



= ejv(A,r), (5.9) 

(5.10) 
(5.11) 



with 



Proof of Proposition\5.3[ We first expand 0jv(A, F): for all A, T in Mfc(C)"'"; we have 



eAr(A,r) 



E 



E 



(idfe (g) tn) 

(idfe (8)Tjv) 
(idfe (g) Tjv) 



N+Tjv (A) - G5„+Tjv (A) ) (g Iat ) 



VA,^(7^,(i^s„+T„(A) ) ® Iat 
(7^.(G5„+T„(A))0 
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By Equation (5.3 1, we get the following: 

N 



E 



n,a: 



(id/c (g) tn) 

= E (idfc(8)TAr) 

= (idfe ® Tat 



lN,A,r[ (A-r)(^lAr) 
A',Aj( (A-r)(g)ljv) 



-i/T^(r)+iJs„+T«(A) 

Ctjv (r) + Gs„+Tm (A), 



which gives Equation (5.9). 



We use the Poincare inequality to control the operator norm oi Qn- {gi, ■ ■ ■ , Qk) are independent 
identically distributed centered real Gaussian variables with variance and f is a differentiable map 
C such that F and its partial derivatives are polynomially bounded, then (see |lll Theorem 2.1]) 

YarfFigi, 



,gK) ) ^v'E^\\VF{g,,...,9K) \[ 

The Poincare inequality is compatible with tensor product and then such a formula is still valid when F 
is a function of the matrices Xn and Yn with = 

We will often deal with matrices of size k x k. Since the integer k is fixed, we can use intensively 
the equivalence of norms, the constants appearing will not modify the order of convergence. For any 
integer K, we denote the Euclidean norm of a, K x K matrix A = {am,n)i^m,n^K by 



and its infinity norm by 



l^ll 



K 



E I- 



Recall that if A, B are K x K matrices we have the following inequalities 



\\A\\^\\A\U,^VK\\A\\ 
\A\\ ^ v^\\A\\^ ^ ^\\A\\e 
\\AB\\ ^ \\A\U \\B\\ 



(5.12) 
(5.13) 
(5.14) 



When A is in Mfc(C) (E) MAr(C), its Euclidean norm is defined by considering A as a kN x kN matrix. 
In the following we will write an element Z of Mfe(C) ® Mjv(C) 



N 



N 



(rn.n) 



(5.15) 



m.n— 1 u.v — 1 



m.n—1 



u.v — 1 



where for m,n — 1, . . . ,N and u,v = 1, . . . ,k, Z™^" is a complex number, Z*^™'") is a fc x fc matrix, and 
Z(„ „) is a X iV matrix; we use the same notation for the canonical bases of Mfe(C) and MAr(C). 
We fix A,r in Mfc(C)+ until the end of this proof and we use for convenience the following notations: 



Mn = 7^,(i^s„+T„(A) ) 

h'^N = ^Sjv+T„(A) 



'at 

In = In. A.r 
Ln L]\r,A.r- 
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We consider {h^^\h^^'^) an independent copy of (h''^^' , h)^' ) , independent of X^r and Yjv (and hence of 



all the random variables considered). Recall that by definitions (5.7) and (5.8 1: for all A, F in 
we have 



In :AeMk{C) ^ /^^^ A /i^^ e Mfc(C), 
Ln :A&Mk{C)^ E[Zjv(yl) 1 e Mfe(C). 



With the notations of (5.151 we have 

(idfc tat) {In ~ Ln) [Mn ® In) ^ 
= (idfc ® tn) [hf {Mn ® In) h^N^] - E (idfc ^ tn) [h^ {Mn ^ In) h 



(1)1 

N J 



1 

N 



(n,m) 



Mn 
Mn 



To estimate the operator norm of O^v we use the domination by the infinity norm (5.131 in order to split 
the contributions due to Mn and due to In — Ln'- we get 



|0jv(A,r)|| 



E 



1 

N 



[(idfc (E) tn) [{In - Ln) {Mn (E) In)] 

N 

E (' 



(2)A 
'AT ) 



< A:^/" max 



m,n— 1 

E 



{m,n) 



(n,m) 



AT 



N 



(M„w,.,xi x: (/,s')"":(c)":'"-E[(c)"':('.y)":'" 



^ max E 



U.V.U ,V 



< max E 



|(AfAr)„.,„-| X 



|(MAr)„,,„.| X 



TAT 



TAT 



(l,2)x 



{k 



(l.2)^ 
JV J 



where we have denoted the N x N matrices 



u' .v' u' ,v' L u' ,v' 



Remark that by (5.14), for = 1, . . . , fc, 

|(MAr)„,,„ 



(A)aJ V||a,|p ||Xs„+T«(A)|| 

\ — / u'v' W — e 



Then by Cauchy-Schwarz inequality we get: 



eAr(A,r)|| A:^/2^||a,|p(E[||A5„+T„(A)||^] max E r^r [(fc^'^O ] 



1/2 



^'/'Ell«jln E V^K^5«+T„(A))„„ max Var(T^[(/i(^'')) u,. 



1/2 



(5.16) 



One is reduced to the study of variances of random variables. To use the Poincare inequality, we write 
for M, V, u' ,v' — 1, . . . , k, 

(iJ5„+T„(A))„,„ = i^W(X^,Yjv), 



Tat 



(l,2)^ 

AT } 



Pu,1,u',v'{'^N,Yn), 
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where for all selfadjoint matrices A = (^i, . . . ,Ap) in Mjv(C), for all B = {Bi, . . . ,Bq) in M^r(C) and 
with Sn = jyj=i '^j ® '^N = ^ hsive set 



Fi]l{A,B) = i^{idk^TN)[{A<E>lN-SN-fN)-^] 
1 



N 



(Trfe ® TrAr) [(e,,„ ® 1n){A ^1n-Sn~ Tn)'^] , 



FS_„,,„,(A,B)=r^ 
1 

N 



(Trfc (E) Trjv) {e^.u <E) 1n){^ (E)1n~ T7v)"^(e„',„' <E) In) {A(E)1n-Sn- TnT^ 



The functions and their partial derivatives are bounded (see |19l Lemma 4.6] with minor modifications), 
so that, since the law of (Xtv, Ytv) satisfies a Poincare inequality with constant f^, one has 



Var (i/5„+T«(A)) < 



— E 
N 



N 



N) 



^ ^u,1.u',v'0^N,^n)\ 



We define the set W of families (V,W) of TV x iV Hermitian matrices, with V = (Vi, . . . , V^), W 
{Wi, . . . , Wq), of unit Euclidean norm in 

. Then we have 



Var(^iJ5„+T„(A) j^^ ^ -E 
Var(rAr[(/i^''V'-] ) < 



max 
(v,w)ew 



max 
(v,w)ew 



i^W(XAr+tV,YAr + iW)'' 

at|t=o 



For all (V, W) in W, for all selfadjoint iV x TV matrices A = (Ai, . . . , Ai), B = (Bi, . . . , Bi): 



|t=o 



f^W(A + tV,B + <W) 



^(Tr^^TrAr) 



P 9 

(e^,_„ (g) 1a,) f A Ijv - ^ flj (g) (Aj- + Wj) - ^ fcj (g (Bj + tW^) 



^(Trfc ® Trjv) [(e„,„ «) ljv)(A ®\n~Sn- f^Y^ 

X \ Y^aj®Vj^^ bj (g) Wj] {A(E}1n - Sn - TnY^ 
The Cauchy-Schwarz inequality for Tr^ igTrjv (i.e. for Tr^Af) gives 



dt\t=o 



i^W(A + tV,B + tW) 



1 

iV2 



(e„,„ (g lAr)(A (g Iat - S'at - Tw)" 



Using (5.14) to split Euclidean norms into the product of an operator norm and an Euclidean norm, we 
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get: 



dt\t=o 



FW(A + iV,B + tW) 



^ ^||e.,«<»liv|le ||(A(»lAr-^7V-rAr)-l||2 



^a,®F, +^6,(»W^, 



< _||(ImA)-ir 



Remark that, since (V, W) £ W, the norm of the matrices Vj and Wj is bounded by one. Then we have 
the following: 

P q p q p q 

E ® + E ® ^1 + ^ E 11^- + 2 E 11^.- lu < ^( E II + E 11^^- 

Hence we finally obtain an estimate of Var(i?5j^+T„ (A) )u,v)'- 

Var(i/5„+T„(A))^^< ^(E||a,||+Ell&.ll)' ll(ImA)-i||^ (5.17) 



We obtain a similar estimate for VarlTjv [(^5v' ) ] ) • '^-^■^'^ partial derivative of F^ j ^, ^, gives two 
terms: V(V,W) e W, V(A,B) e MAr(C)P+9 

= ^(Trfe ® TrAr) [(e,,„ l^)(r Iat - f^)-i ( E ® ^.7" 

X (r ® Iat - TV)"^(e„',„' lAr)(A (g) Iat - S-AT - Tn)-^ 
+ (e^,,„ (g) lAr)(r (g) Ijv - Tw)"^(e«'V (g lAr)(A g) Ijv - S-AT - fjv)~^ 

X ( E «J + E M^j"^^) (A (g Ijv - - T^v)-' . 



We then get the following: 



_1 



^nin'.'(A + tV,B + tW) 



^ ^(Ell«.-|l+Ell^.H)' Il(lmr)-'IP ||(ImA)-i|p(||(ImA)-i|| + ||(Imr)-i| 



Hence we have 



Var(Tjv[(/i^''^) 

^ ^(E ll«.H +E Il^j-Il)'ll(li^^ IKlrn A)-i|p (iKlrn r)-i|| + ||(Im A)-i||)'. (5.18) 



We then obtain as desired, by (5.161, (5.171 and (5.181: 

p 



ejv(A,r)|| ^ k^^'j^W'^^WH T.^'''<^s.+T^{^^)uv max Var(rA,[(/i(^^^))«,«] 



u,v — l 



1/2 



^||(Imr)-i||||(ImA)-if (||(Imr)-i|| + i|(ImA)-i|lJ, 



where c = k^'^aY^U W{T.U H^^H + 



□ 
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5.3 Proof of Theorem 5.1 



By (4.5 1, for all A in Mfc(C)+; the matrix A — TZg (Gsw+Tw (A) ) is in Mfe(C)'*" and then it makes sense 



to choose r = A - 7^s (Gs„ +Tjv(A) ) in Equation ( |5.9| . We obtain for all A in Mfc(C)+, 
G5„+T„(A) = GT„(A-7^,(Gs„+T„(A) ) ) + eAr(A), 



where 0jv(A) = Q ^ ( A, A — TZs[G s,^+Tn i-^) ) ) is analytic in complex variables. Recall that by (4.6 1 



we have ||(A — 72,s(G5„+Tjv (A) ) ) ^|| ^ ||(A) "'"H, which gives (when replacing c in (5.111 by c/2) the 
expected estimate of On (A). 

6 Proof of Estimate (3.9) 

Let (Xat, Yat, X, y) be as in Sectional We assume that (x, y, (Yjv)w^i) are realized in a same C*- 
probability space (A, .*,t, || • ||) with faithful trace, where 

• the families x, y, Yi, Y2, . . . , Y^r, . . . are free, 

• for any polynomials P in g non commutative indeterminates r[P(Yjv)] ■— tn[P(Y n)]. 

Consider L a degree one selfadjoint polynomial with coefficients in Mfc(C). Define the Stieltjes transform 
of Lat = L(Xn,Yn) and In = i(x, Yw): for all A e C+ = {z e C| Im z > O}, 

5L„(A) = E {Tk(E)TN) {Xlk<E)lN~LNy^ , (6.1) 
ge^W = (Tfe®T)[(Alfc® l-^AT ]. (6.2) 
One can always write Ln — ao(^ In + Sn + Tjv, £n = 0,0 'S^ 'i- + s + T/v, where 

p p q 

j=i j=i i=i 

and Cq, . . . , Op, bi, . . . ,bq are Hermitian matrices in Mfc(C). Define the Mfe(C)-valued Stieltjes transforms 
of Sn + Tn and s + Tn: for all A e Mfe(C)+ = {A G Mfe(C) | Im A > O}, 

Gs«+T„(A) = E (idk®TN) {A®1n - Sn - Tn)"^ 

G,+T„(A) = (idfc(8)T)[(A(8)l-S-rAr)"^ 

Then one has: for all A in 

9LnW = '''k Gs„+T„ (Alfc - ao) , 5£„(A) = Gs+t„ (Alfc - ao) 



By Proposition 4.2 for any A e Mfe(C)+, one has 

G,+T„ (A) - Gt„ (a - 7^, (G,+T„ (A) ) ) . 
On the other hand, since the matrices of Yn are deterministic, we can apply Theorem |5 . 1 1 with a = 1 
Gs„+T„(A) = GT„(A-7^,(G5„+T„(A) ) ) +ejv(A), 

where |10jv(A)|| ^ A)^^||^ for a constant c > 0. Define 

rif) = {a e Mfc(C)+| ||(Im A)-i|| < A^"}. 
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Then for 77 < 1/3, there exists iVo such that for all N ^ Nq and for any A in f^f ) , one has 
n{A) :-||eAr(A)|| ||(ImA)-i|| ^ ||a,|p < ^|| (Im A)-i|r c7V«"-2 < 



Then by Proposition |4. 3 [with {t,G,e,n,e) = (Tat, Gs„+t„ , ©jv, % 1/2), one has 
||G,+T„(A)-G^,„+T„(A)|| (l + 2f]||a,|p ||(ImA)-i|p) ||e(A)|| 



3 = 1 
P 



^ c(l + 2^|la,f IKlmAr^lp 



|(Im A)-i||5 
iV2 ■ 



Hence for every e > 0, there exist No and 7 such that for all N ^ Nq, for all A in C such that 
e (Im A)-i < iVT, one has 

\9LmW - geN^l < l|Gs+T„(Alfe - an) - Gs„+T„(Alfe - ao)|| ^)~^ (6-3) 



2 



where c denotes now the constant c = k^'^ llajll (Ej=i llajll + E|=i ll^jll) (^"^ + 2Ej=i l|a 

7 Proof of Step 2: An intermediate inclusion of spectrum 

For a review on the theory of C*-algebras, we refer the readers to [T5] and [5]. Notably, Appendix A of 
the second reference contains facts about ultrafilters and ultraproducts that are used in this section. 

Let (x, y, (Yjv)jv^i) be as in Section |3] We assume that these non commutative random variables 
are realized in the same C*-probability space {A, ■*,t, || • ||) with faithful trace, where 

• the families x, y, Yi, Y2, . . . , Yn, . . . are free, 

• for any polynomials P m q non commutative indeterminates r[P(Yjv)] '■— tjv[P(Yjv)]. 

A consequence of Voiculescu's theorem and of Shlyakhtenko's Theorem |A.1| in Appendix \K\ is that for all 
polynomials P in p + q non commutative indeterminates, 

r[P(x,Y^)] ^ T[P(x,y)], (7.1) 
||P(x,Ya.)|| ^ ||P(x,y)||. (7.2) 



In order to prove Step 2, it remains to show that (7.2 1 still holds when the polynomials P are Mfc(C)- 
valued. This fact is a folklore result in C*-algebra theory, we give a proof for readers convenience. We 
need first the two following lemmas. 

Lemma 7.1. Let A and B be unital C* -algebra. Let it : A ^ B be a morphism of unital * -algebra. Then 
TT is contractive. 

Proof. It is easy to see that for any a in A, the spectrum of 7r(a) is included in the spectrum of a (since 
Al_4 — a invertible implies that Al^ — '^{o) is also invertible). Hence we get that for all a in A 

|K(a)||2 = \\Ti{a*a)\\ ^ \\a*a\\ = \\a\\\ 

□ 

Lemma 7.2. Let A be a unital C* -algebra. Then for any integer k ^ 1, there exists a unique C* -algebra 
structure on Mfc(C) <S) A compatible with the structure on A. In particular, if A is a C* -probability space 
equipped with a faithful tracial state t, then Mfe(C) (E) A is a C* -probability space with trace (r^ ® r) and 
norm \\ ■ llrt^T! where is the normalized trace on Mfc(C) and \\ ■ ||i-fc(giT is given by Formula (1.9l. 
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Sketch of the proof. For the existence we consider the norm given by the spectral radius. The uniqueness 
follows from Lemma [7. II □ 



Proposition 7.3. Let k ^ 1 be an integer. For all N ^ 1, let zn ~ {z[^\ . . . , Zp^"^ ) , respectively 
z — (zi, . . . , Zp), be self-adjoint non commutative random variables in aC* - probability space {An^ ■* , tn, ||' 
\\tn)j respectively {A, ■*,t, \\ ■ \\r). Assume that the traces tn and t are faithful (hence the notation for 
the norms) and that for any polynomial P in p non commutative indeterminates, 

MPM] ^ t[F(z)], (7.3) 
WPMWr. ||P(z)||,. (7.4) 

Then for any polynomial P in p non commutative indeterminates with coefficients in M/^(C), 

ll^(z)||r.«r. (7.5) 

We abuse notation and write with the same symbol the traces in Mj,(C) and when N = k. There is 
no danger of confusion. 

Proof. For any positive integer k and any ultrafilter U on N, we define the ultraproduct 

u 



= J|Mfe(c)(»^^, 



which is the quotient of 

by 



(aw) 



N>1 



\/N > 1, ajv e Mfc(C) (8) An and sup||aAr|| < oo 

N>1 



yN ^ 1, OTv e Mfe(C) (g> An and lim llajvll = 

N^U 



The algebra SlC') is a C*-algebra whose norm || • \\r^(k) is given by: for all a in St'*^', equivalence class of 

{0'n)n^1 

\H\<2iW = l™,l|aA'liTfc«)Tjv 



Furthermore 21^'^'' is a C* -probability space which can be identified with Mfe(C) ® 2t'^^ The trace f on 
21(1) is given by: for all a in St'-^-', equivalence class of {An)n^i, one has 

f[al = lim rfAjvl. 

n^u 

If the classical limit as N goes to infinity exists, then the trace of a does not depends on the ultrafilter 
U and is given by the limit. The trace on Sl^*^) is (r^ (g) f). Notice that (r^ (g) f ) on St'*^) is not faithful 
in general, which implies that the norm || • \\<^{h) and the norm || • ||Ti.(g)f given by {t^ ® f) with Formula 



(1.9 1 are not equal on the whole C*-algebra. 

At last, we can equip St^*^) with a structure of operator-valued C* -probability space. Define the unital 
sub-algebra B of 21^^) as the set 



The conditional expectation in St^*^-* is given by (idfe ® t) : SlC^) ^ B. 

For j — we denote by zj in St'-i) the equivalence class of the sequence (zj^'')Ar^i. We have 

by definition of 2l('°'': for all polynomial P in p + 2q non commutative indeterminates with coefficients in 

Mfc(C), 

\\P{zN)\\r. ll^(z)|kw 
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Let C*(z) be the sub-algebra spanned by z = (zi, . . . , Zp) in 21*^^^ and let C*(z) be the sub-algebra spanned 
by z in A. Then by (7.4 1, the C*-algebras C*(z) and C*(z) are isomorphic. Hence we get an isomorphism 
of the *-algebras Mk{C) (E)C* (z) and Mfc(C) (8)C*(z), and so an isomorphism of the C*-algebras by Lemma 
|7.1[ Hence, for all polynomial P in p + 2q non commutative indeterminates with coefficients in Mfc(C), 

||P(z)||a<., = \\Piz)\\r,m 

Hence we get 

ll^(ziv)|!Tfe(3r„ — \\Piz)\\r^tg,f 

for all ultrafilter U. Then the convergence holds when N goes to infinity. □ 

Proof of Step 2. Let L be a selfadjoint degree one polynomial in p + q non commutative indeterminates 
with coefficients in M/j(C). Define £iy = L(x, Yat) and £ = L(x, y). Then by Proposition 7.3 for all 
commutative polynomials P, one has 

\\P{^N)\\r,^r ll^Wllr.^.. 

The convergence extends to continuous function on the real line and then, with an appropriate choice of 
test functions. Step 2 follows. □ 



8 Proof of Step 3: from Stieltjes transforms to spectra 

Let Xat, YAr,x and y be as in Section [3j As before x, y, and Y^r are assumed to be realized in a same 
C* -probability space {A, .*, r, || • ||) with faithful trace. Let i be a selfadjoint degree one polynomial with 
coefficients in Mfe(C). 

For any function / : M — ^ M and any Hermitian matrix A with spectral decomposition A = f/diag (Ai, . . . , Aa' 
with U unitary, we set the Hermitian matrix f{A) = [/diag {f{Xi),...,f{XK))U*. For any function 
/ : M i-^ M, we set 

DNif) = (Tfe®rAr)[/(L(XAr,YAr))]. 

By Step 2, for all e > 0, there exists Nq ^ 1 such that for all N ^ Nq, one has 



Sp( L(x, Yat) ) C Sp( L(x,y) ) + (-e,e). 



Hence, for any function / vanishing on a neighborhood of the spectrum of L(x, y), there exists Nq ^ 1 such 
that for all N ^ A^'q, the function / actually vanishes on a neighborhood of the spectrum of £(x, Y^r). In 
particular, with /ijv (respectively vn) denoting the empirical eigenvalue distribution of i^r = L(Xjv, Yjv) 
(respectively £n = i(x, Y^r)), one has 



E 



DNif) 



= E 



fdfi 



N 



= E 



/d/i 



N 



f di^N- 



(8.1) 



Furthermore, by Estimate (3.9 1, with the Stieltjes transforms of and of defined by: for all A in C+ 

1 



gL„(A) = E (Tfe Tjv) ^ (Alfe ® Iat - 



= E 



X-t 



d^Ar(i) 



1 



X-t 



dvN{t), 



we have shown that: for any e > and A > 0, there exist No,c,ri,^,a > such that for all N ^ Nq, for 
all A in C such that e < (Im A)"^ < TV and |Re A| A 



l5L„(A)-5f„(A)| ^ ^(Im A)- 



(8.2) 



With (8.1) and (8.2 1 established, it is easy to show with minor modifications of fP, Lemma 5.5.5] the 
following result. 



8 PROOF OF STEP 3: FROM STIELTJES TRANSFORMS TO SPECTRA 



27 



Lemma 8.1. For every smooth function / : M — > M non negative, compactly supported and vanishing on 
a neighborhood of the spectrum o/L(x, y), there exists a constant such that for all N large enough 



K[DN{f) ] 



< 



Ar2- 



(8.3) 



To get an almost sure control of D]y{f), we use the fact that the entries of the matrices X^r satisfy a 
concentration inequality. 



(8.4) 



Lemma 8.2. With f as in Lemma \8.1\ there exists k > such that, almost surely 

N'+^'DNif) 0. 



Proof. The law of the random matrices satisfying a Poincare inequality with constant and L being a 
polynomial of degree one, for all Lipschitz function 'J : Mfcjv(C) > M, by |17l Lemma 5.2] one has: 

^'(LAr) -E[^'(LAr) ] | > (5^ ^ i^ie"-^" TO , (8.5) 

where Ki, K2 are positive constants and |5'|£ = sup ^^^\\a-b\\^''^ • -R-^call that the Euclidean norm 
II • lie of a matrix A — {ai,j)^j^i is given by 



II^IU 



kN 



For any Hermitian matrices A in Mfe7v(C) and any function / : M — > 

<S>^j^\A)^iTk(g>TN)[f{A)]. 
For all smooth function / : M — > M, iV ^ 1 and < k < |, we define 



we set 



(8.6) 



b\^1 = \Ae MkNiC) 



A is Hermitian and 



and denote p^j^l = l(*w^e„,J£• Define : MfeAr(C) ^ M by: VA G Mn{ 

^^^\A)^ sup U^j^\b)~p^^I\\a-b\\A, 



and denote DnU) = '^'"^\Ln). By [17, Proof of Lemma 5.9], ^"^^ coincides with on B'^^'^ and is 



(/) 



(8.7) 



,(/) 



?(/) 



Lipschitz with constant |^j^''|£ ^ P^n'k. 



For all Hermitian matrices A in MfeAr(C), M in MfeAr(C) and n ^ 1, one has f^^^iA + iM)" = 
E™=o ^"^'^^""""^ and then ^|j^o(Tfe ® tn)[{A + iM)"] = (rfe ® tjv)M""^M]. So for all polyno- 
mials P, one has D^$^-'(M) = (r^ (g) Tjv)[P'(yl)Af]. Hence, by density of polynomials, for any smooth 
function / : M — > M one has D^'&j^-' (Af ) = (t^ ®Ti^)[f'{A)M]. By the Cauchy-Schwarz inequality, we get 

\Da^^I\m)? = |(T,®r^)[/'(A)M]|2 



(rfe ® TN)[f'{Af] X (Tfe ® tm)[M*M\ 



kN 



Then, for any smooth function /, one has 



„(/) 



'kN 



(8.9) 
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where || • ||oo denotes the supremum of the considered function on the set of kN x kN Hermitian matrices. 
Hence we get that ^ p^^^^ -1= Ar-i/2-2«:^ 

We fix / a smooth function, non negative, compactly supported and vanishing on a neighborhood of 
the spectrum of L(x, y). By the Tchebychev inequahty 



(8.10) 



where we have used Lemma 8.1 (/'^ also vanishes in a neighborhood of the spectrum of L(x, y)). Moreover, 



since ^fj^^ and are equals in B'}^\ and ||*^^|loo ^ ||*^''||oo, 



E[DN{f) - DnU)] ^ ||<i>k^^||ooP(iiv ^ II* 



?(/) 



N jy2-4:K 



.11) 



Now, by (|8.5|) appHed to ^-^^ for all (5 > 

DNif)-E[DNif)] > 



and Ln e b']^\ 



^ P 



DN{f)~E[DNif) 



> 



^ K,exp(^-VkK2N''{S- \E[DN{f)~DNif)]\)^ 



By (8.101, (8.111, Lemma 8.1 and the Borel-Cantelli lemma, DM{f) is almost surely of order N^^^ at 
most. □ 



Proposition 8.3. For every e > 0, there exists Nq such that for N ^ Nq 

Sp( L(Xjv,Yjv) ) cSp(i(x,y) ) +(-£,£) 



.12) 



Proof. By ( |1.11[ ) and [TJ Exercise 2.1.27], almost surely there exists Nq € N and D ^ such that the 
spectral radii of the matrices (X^r, Yat) is bounded by D for all N ^ No. Hence, there exists M ^ 
such that almost surely one has 

Sp(i(Xjv,Yw) ) c hM,M]. 

Let / : M I— > M non negative, compactly supported, vanishing on Sp( L(x,y) ) + (— e/2,e/2) and equal 
to one on [—M,M] \ (Sp( L(x, y)) + (—£,£) )• Then almost surely for N large enough, no eigenvalue of 
L(X7v, Y^v) belongs to the complementary of Sp( L(x, y) ) + (— e,e), since otherwise 



{Tk0TN)[f{L{XN,YN) 

in contradiction with Lemma 18.21 



□ 



9 Proof of Corollaries 2.1, 2.2 and 2.4 
9.1 Proof of Corollary 2.1: diagonal matrices 



Let Dat = {D[^\...,D'g"') be as in Corollary 2.1 For any j = 1, . . . ,p, the number of jump of F is 



1 ;„ 



countable. We show that the convergence of the norm ( 2.3 1 holds when we chose v — {vi, . . . ,Vq) in [0, 1]"^ 
such that for any k ^ £ in {I, . . . , q}, the sets of jump points of u H> F^^{u + Vk) and u i— >■ Ff^{u + Vi) 
are disjoint. We show that for such a v, the family D]^ satisfies the assumptions of Theorem 1.6 In all 

this section, we always denote instead of A^''^^ for any i = I, . . . , N. 
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The convergence of traces, case v = (0, ...,0): Since the matrices commute, we only consider 
commutative polynomials. We start by showing that for all polynomials P, 



tn 



N—>oo 



p(^F^\u),...,F^\u) 



(9.1) 



Denote by /i the probability distribution of the random variable (^F^^ (U), . . . , Fr^{U) ) G M'^, where 
U is distributed according to the uniform distribution on [0, 1]. In order to get ( |9.1[ ), we show that the 
sequence of measure in M'' 

1 ^ 1 ^ 

2 = 1 1 = 1 

converges weakly to ^. This sequence is tight, since there exists a, B > such that for all j = 1 ... q, for 
alH = 1 . . . A^, one has Xi{j) E [—B, B]. Hence it is sufficient to show the following: for all real numbers 
ai, . . . , flg, for all e > 0, there exists rj > such that 

limSUp — ^ l]_oo,ai+r,] (Aj(1)) X • • • X l]_oo,a,+,,] (^liq)) - /i( ] - OO, fli] X • • • x] - OO, ttg] ) E. (9.2) 



Fix (ai, . . . , Oq) in and e > 0. Remark that one has 

/i( ] — OO, ai] X • • • x] — OO, a„] ) = niin Fj(aj). 

j = l...q 

Let Jo be an integer such that Fjg{ajg) = /i( ] — oo, ai] x • • • x] — oo, a^] ). For any j = 1, . . . , g, the 

empirical spectral distribution of -Oj^'' converges to fij . Then for all a in M point of continuity for Fj , 
one has 



N 



1=1 



(9.3) 



Let 77 > such that 

• Mjo( ]ajo>«jo +'7] ) < e/2- 

• for all j 1, . . . , g, the real numbers aj + rj and + rj are points of continuity for Fj. 



By (9.3 1 with a = aj + rj, there exists A'o 1 such that for all N ^ Nq and j = 1, . . . ,q, one has 

Fj{aj + 77) - e s$ j^^^""^ {i = l...N A,(j) < + 77 j. 
But Fj{aj + 1]) ^ Fj{aj) ^ Fjg{ajg). Then we have 

^(-F^oKo) - e) ^ Card {z = 1 . . . | A,(j) + 77 }. 
The Ai(j) are non decreasing, so we get 

Vj = 1 . . . g, Vz < A^(f,„ (a,J - e) , A,(j) < + 77. 



(9.4) 



On the other hand, by (9.3) with j = jo and a = + 77, there exists iVo ^ 1 such that, for all N > iVo, 
one has 

\card |i = l...iV 



N 



>^^ijo) ^ aj„ + 7; I ^ ^jo(ajo + '?) + £/2 



But -P,o(«io + ?7) < ^jo(«jo) + so that 

Card |i = 1...7V 
The Ai(jo) are non decreasing, then we get 

Vz ^ N(^Fj„{aj„) + e) , A,(jo) > + 77. 



(9.5) 
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By ([g^l and ([9^ we obtain: for all N ^ Nq 

N 



1=1 



and then (9.2 1 is satisfied. So the convergence (9.11 holds when v is zero. 

The convergence of traces, case v in [0, 1]'': To deduce the general case we shall need the following 
lemmas. 

Lemma 9.1 (Quantiles of real diagonal matrices with sorted entries). Let Dm — diag (Ai, . . . , Ajv) &e 
an N X N real diagonal matrix with non decreasing entries along its diagonal. Assume that the empirical 
eigenvalue distribution of D^ converges weakly to a compactly supported probability measure /i. Let F 
denote the cumulative distribution function of /i and F^^ its generalized inverse. Let v in (0, 1) a point 
of continuity for F^^ and {iN)N^i o, sequence of integers, with in {1, . . . , N}, such that in/N tends 
to V. Then, one has 

In particular, we have the convergence of the quantile of order v: 

A'— ^oo 

Proof. Denote w = F^^{v). Let ^ be such that w — rj and w + rj and points of continuity for F. 
Then, one has 

1 ^ 

— V l]-oo.w-r,] (Aj) — ^ 00,W ~T]]) = F{w - 77). 

i=l 

Then, the Ai being non decreasing, for any e > there exists A'o such that for any N ^ Nq, one has 

Vi;? (^F{w--n)+e^N, X,^w-ri. (9.6) 

Since u is a point of continuity for F~^ , we get that F(w — rj) < v. We chose e < v — F{w — rj). Then, we 
get F{w — rj) + e < V. Hence, there exists Nq such that, for any N ^ Nq, one has i^ ^ [F{w ~ rj) + e)N 
and so, by ( |9.6[ ): for any 77 > 0, there exists Nq such that for all N ^ Nq, one has w — rj ^ Ai„. Hence, 
we get for all 77 > 0, 



With the same reasoning, we get that 



w — rj ^ lim inf Ai„ . 



lim sup Aj„ ^ w + T], 

N^oo 



and hence, letting 77 go to zero, we obtain the expected result. □ 

Lemma 9.2 (Truncation of real diagonal matrices with sorted entries). Let D^ = diag (Ai, . . . , Xn) an 
N X N real diagonal matrix with non decreasing entries along its diagonal. Assume that the empirical 
eigenvalue distribution of D^ converges weakly to a compactly supported probability measure /i. For any 
vi < V2 in [0, 1], we set 

^^i,t>2 ^ jjg^g (Ai+|^„j7vj , . . . , AlijjAtj). 

Let F denotes the cumulative distribution function of ji and F^^ its generalized inverse. We set wi = 
F^^{vi), W2 = F~^{v2), ai — F(wi) — vi and 02 = V2 — F{w2). Then, the empirical eigenvalue 
distribution o/Z?j^^'"^'' converges weakly the probability measure proportional to 
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Proof. We only show the lemma for V2 — 0, the general case can be deduce by adapting the reasoning. 
We then use, for conciseness, the symbols v, w and a instead of vi, wi and ai respectively. 

If F is not continuous in w (i.e. if fi{w) ^ 0) and v ^ F{ w), t hen for any a in ]0,{F{w) — v)/2[, 
the map F^^ is continuous in v + a and F{w) — a. By Lemma [9. l[ we get that 



lim Xi+\(v+a)N\ = lim F{w)-a)N\ = w. 

N — ^oo — ^oo 



Hence, for any continuous function /, we get 

l+[{F{w)-a)Ni 



1 

TV 



E 



/(A.) (a-2a)/H. 

N^oo 



(9.7) 



(9.8) 



i=l+l{v+a)Ni 

If F is continuous in w, we take a = in the following. 

We can always find /? > 0, arbitrary small, such that F{w) + /3 is a point of continuity for F^^. Remark 
that we then have 

w = F-\F{w)) < F-\F{w) + 13) . 

By Lemma [9.1 1 we get 

Xi+l(FM+m\ F-'{F{w) + ^). (9.9) 

Moreover, we can always find 7 in ]0, F^^ (^F{w) + /?) — w[, arbitrary small, such that w + 7 is a point of 
continuity for F and F{w + 7) < F{w) + (3. Then, by (9.9 1, we get that, for N large enough 

Card| [{F{w) - a)N\ A, w + 7 | s$ \ {F{w) + /3)7VJ - \ {F{w) - a)N\ . 

Hence, for any continuous function /, we get that for large enough 



AT 



i^l^l{F{w)-a.)N\ 



]cj,4-oo] 



1 ^ 

^E/(^^)i 



](A.)- 



L(f (w) + p)N\ - [{F{w) - a)N\ 
N 



f{x)dfi{x) 
(9.10) 



By (|9.8| and (|9.10|), we obtain 

N 



lim sup 



1 ^ f{X,)-af{w)~ f 



f(x)d^i{x) 



i=l+[vN] 

Letting a, [3,^ go to zero, we get the result. 

Let V in [0, l]"*. We now show that, for any polynomial P, one has 



||/|U(4« + /3 + M(]ii',u; + 7])). 



TN 



N- 



p[F^\u + vi),...,F-\u + Vq) 



□ 



(9.11) 



At the possible price of relabeling the matrices, we assume vi ^ . . . ^ Vq and set 



[v,-iN\ - \v,N\, yj = l,...,q. 



For any j = 1, . . . , we decompose the matrices D^-^\vj) into 



Df\v,)^ dmg{D]';>,...,D 



(AT) 



3,q ' 



where for any i = 1, . . . , g, the matrix -Oj^'' is Ni x Ni. We set for any i = 1, . . . ,q, the family Dpfl^i) — 
(Z?[^\ . . . , I?^^'). For any i,j — l,...,q, we denote by Fij the cumulative distribution function of 
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the measure obtained in Lemma 
polynomial P, one as 



9.2 



with {Dn, fi,vi,V2) replaced by {Dj^\ fj,j,Vi-i,Vi). Then, for any 



i=l 



N 



By Lemma 9.2 and by the case v — (0, . . . , 0), we deduce that 

1 



rjvjF(Djv(i))] 



p[F-^\u + v,),...,Fr^\u + v,)yu, 



with the convention vq ~ 1. The merge of the different measures gives as expected 



N- 



p(^F-\u + vi),...,F-'{u + Vq) 



(9.12) 



The convergence of norms: Let v = {vi, . . . , Vq) in [0, 1]"^ such that for any fc 7^ ^ in {1, . . . , g}, the 
sets of jump points of u i-> Ff7^{u + Vk) and u i-> F^^{u + vi) are disjoint. We now show that, for all 
polynomials P, one has 

\\P{Til)\\ Sup |P|, 

where /i^ is the probability distribution of the random variable {F^'^{U + wi), . . . , F~^{U + Vq) ) G M', 
where U is distributed according to the uniform distribution on [0, 1]. In view of the above, we have 

liminf \\P{T>'%)\\ ^ Sup |P|. 

Supp /i^ 

It is sufficient then to show that, for any > 0, there exists Nq ^ N such that for all i = 1, . . . ,N, one 
has 

(^K+lviN\ (1), • ■ ■ , \+lv^N\ (9) ) e Supp fl" + (-77, 7]^. (9.13) 

Indeed, by uniform continuity, for any polynomial P and e > 0, there exists 77 ^ such that, for all 
{xi, . . . , Xq) in Supp + [—1, 1]^ and (yi, . . . , y^) in W, one has 



\yj-Xj\<ri P{xi,...,Xq)- P{yi,...,yq) 



< e 



and hence: for all £ > 0, there exist rj ^ and Nq ^ 1 such that for all N ^ Nq, for alH = 1, 



,N 



max 

i=l...N 



P{\+[viNi (1), ■ • ■ , K+lv^N] (<?) ) 



^ max 

Supp fl^ + { — 71.7l)l 



P ^ max |P| +e. 

Supp fj,^ 



Suppose that (9.131 is not true: there exist rj > and {Nk)k^i an increasing sequence of positive integer 
such that for all k ^ 1, there exists ik such that 



( 



1) 



{q) ^ Supp/." + (-,7,77)^. 



By compactness, one can always assume that ik/N^ converges to uq in [0, 1]. For all j i n |1 , . . . ,q} except 



9.1 



A 



(Nk) 



a possible Jq, we have that uq + Vj is a point of continuity for Fj ^ and so, by Lemma 
converges to F^^{uo + fj). Recall that 

Supp ^{{F,-\u + vi),...,F-\u + Vq)) \ ue[0,l] }• 

Then we have, for N large enough and for all u in [0, 1], that lA^^j* „ , (jo) — F^^{u + Vj^M > rj i.e. 



which is in contradiction with the fact that for TV large enough the eigenvalues of d'^^^ belong to a small 
neighborhood of the support of /ij,, . 
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9.2 Proof of Corollary 2.2: Wishart matrices 



Let r, si, . . . , Sp ^ 1 and (W^v, Y^v) be as in Corollary 2.2 and denote s = si 



. . + Sp. We use matrix 

manipulations in order to see the norm of a polynomial in the rN x rN matrices W^v, Y^v, as the 
norm of a polynomial in (r + s)N x (r + .s)N matrices Xjv, Y^r, Y^, Z^r and some elementary matrices, 
where Xjv is a family of independent GUE matrices and Yjy, Zjv are modifications of Yjv, Zjv- We will 
obtain the result as a consequence of Theorem |1.6[ 



Define the (r + s)N x {r + s)N matrices e^v = {so^\ 



IrN 

OsN,rN 



OrN,sN 
OsN 



(9.14) 



/ 



rN 







(si+--+Sj_i)iV 



l-s-iN 



\ 



3 = 1, 



0(sj+i+---+Sp)Ar / 

Recall that by definition of the Wishart matrix model for j = \, . . . ,p 



W, 



(N) 



(9.15) 



(9.16) 



where m]^^ is an rN x SjN complex Gaussian matrix with independent identically distributed entries, 

centered and of variance 1/rN. Let Xjv = {x[^\ . . . jXp^"^) be a family of p independent, normalized 
GUE matrices of size (r + s)N x (r + s)N, independent of Yjy and Z^v and such that for j — 1, . . . ,p, 

r+s^jA^) ^YiQ following way: if we denote 



the rN x SjN matrix Afj^' appears as a sub-matrix of 

n 

/ OrN 
\ 



'^ef^lf ^ef ) then 



M. 



(N) 







(sj + iH \-Sp)N 



(9.17) 



Let Yjv 
defined by: 



(N) 



and Zjv = 

y(JV) ^ 



(N) 



, Zp 



) be the families of (?■ + s)N x (r + s)N matrices 



(N) 



OrN,sN 
OsN 



/ OrN 



V 







(siH hSj 



)N 



0, 



l,...,q, 
J 



i = 1, 



(9.18) 



(9.19) 



'(sj + i+---+Sj,)N 

By assumption, with probability one the non commutative law of Y^r converges to the law of non 
commutative random variables y — (j/i, . . . , y^) in a C* -probability space {Aq, .*, t, || • ||) and for j — \ . . .p 
the non commutative law of Zj converges to the law of a non commutative random variable Zj in a C*- 
probability space {Aj, .*,t, || • ||) (we use the same notations for the functionals in the different spaces). 
All the traces under consideration are faithful. Let B denotes the product algebra Bq y. Bi y. ■ ■ ■ y. Bp. 
We equip B with the involution .* and the trace f defined by: for all (&o, • ■ ■ , bp) in B 



{bo,...,bpr = {b*,...,b;), 



{bo 



,bp)]= -—T{bo) + 
■' r + s 



si 



t(6i 



-^r{bp). 
r + s 



The trace f is a faithful tracial state on B. Equipped with .*, f and with the norm || • || defined by ( |1.9[ ), 
the algebra S is a C* -probability space. Define y = (^i, • • • , ijq), z = (zi, . . . , Zq) and e = (eg, . . . , Cp) by 



Vj = (?;j,0ei,...,0ej, j = 1,- 



,q, 
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Zj = (Oeo,...,Oe^_j,Zj-,Oej+i,...,Oi5j, j = 
ej = {Obo,- ■ ■ ,0e,_i,le,,0e,+i,. • • ,OeJ, j = 0,...,q. 

Lemma 9.3. With probability one, the non commutative law of (Y^v, Zat. e^r) in (M(r^3-)7v(C), .*, 
T(r+s)N) converges to the law o/(y,z, e) in (B,.*,f). 

Proof. Let P be a polynomial in 2p + 2q + 1 non commutative indeterminates: 

'''(r+s)Jv[-P(YAr,Y^,Zjv,e7v) ] 

= , TrN IPO^N, Yat, OrN, ■ ■ ■ , OrN, 'i-rN,OrN, ■ ■ ■ , OrAf) 1 

r + s ■> ^ ^ ■' 

P P 

P ^ 

+ r^'^'-'j [-^i^s-iN, ■ ■ ■ 1 Os-N, Z^-^\Os-N, ■ ■ ■ , Os^N, IsjiV, 0^^.^, . . . , 0^^^?) ] 

2g+i-i p p-j 

p p 

p 

+ I]^^[^(0^_^,^„ 0_^,l, 0__.^) ] (9.20) 

2g+j — 1 p p—1 

= f[P(y,y*,z,e) ], (9.21) 
where the convergence holds almost surely since each term of the sum converges almost surely. □ 
Lemma 9.4. For all polynomials P in 2p + 2q + 1 non commutative indeterminates, almost surely 

\\P{YM,Y%,ZN,eN) II ||P(y,y*,z,e) ||. 

Proof. Lemma [9 . 4 1 follows easily since for any polynomial P in 2p+2g+l non commutative indeterminates, 
||P(YAr, Y^, ZAr,eAr) || is the maximum of the p+1 real numbers 



\PO^N, Y^, OrN, ■ ■ ■ , OrN, 'i-rN,OrN, ■ ■ ■ , Or7v)|| 



P P 



• \\P{Os^N, ■ ■ ■ ,OsjN, Z^,^\Os^N, ■ ■ ■ ^Os-nAsjN, Os^.at, . . . ,Os^.Ar)||, j = l,...,_p, 

V ' " V ' V/ ' 

2g+j-i p p-j 

and ||P(y, y*, z, e)\\f is the maximum of the p+1 real numbers 

. ||P(y,y*,0_^,l,0__^)||, 

p p 

• ||P(0^_^, zj, 0_^3 1, 0^_^)||, J = 1, . . . ,p. 

29+j-i p p-i 



□ 



Let X — (ii, . . . ,ip) be a free semicircular system in C* -probability space. Let A be the reduced free 
product C*-algebra of B and the C*-algebra spanned by x. We still denotes by f the trace on A and the 
norm considered || • || is given by (1.9 1 since the trace is faithful. By Voiculescu's theorem and by the 
independence of X^r and (Y^r, Z^r), with probability one the non commutative law of (Xjv, Yjv, Z^r, ejv) 
in (M(r+s)Ar(C), .*, T(r+s)Ar) converges to the non commutative law of (x, y, z,e) in {A,.*,t). Define the 
non commutative random variables m = {rhi, . . . , rhq) and w = {wi, . . . , Wq) in A by: for j = 1, . . . , g, 



—^—eoXjCj, Wj — eo{'mj Zj +to*)^. (9.22) 
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Lemma 9.5. For any polynomial P inp + 2q non commutative indeterminates, there exists a polynomial 
P in 3p + 2q + l non commutative indeterminates, such that one has 

( -P(Wjv, Yjv, Y^) OrN,8N \ _ pz-v; v V* 7 ^ \ (CyW 
\ yJsN,rN yJsN J 

eoP(w,y,y*) = P(x,y,y*,z,e). 
Proof. We set Wjv = {W^^\ . . . , Wp^^) given by: for j = 1, . . . ,p, 

V OsJV,rJV O5JV / 

Let P be a polynomial in p + 2q non commutative indeterminates. By the block decomposition of Wjv 
and Yjv, one has 

/ P(Wjv, Yjv, Y|^) OrN.sN \ _ (N) pfoT V V* ^ 

n n ~ ^0 -^(.VVjv, Yjv, I jvj- 

\ ^sN,rN ^sN J 

Furthermore, By definitions of X and W: for j = 1, . . . ,p 

Define for j = 1, . . . ,p the non commutative polynomial Pj deduced by the formula 

Pj{xj, Zj,e) = eo ^ ^ {eoXjSjZj + ejXjeo)^, (9.25) 

and define P deduced by 

-P(x,y,y*,z,e) = Co p(^Pi{xi,zi,e),...,Pp{xp,Zp,e),y,y*y (9.26) 

The polynomials are defined without ambiguity if x, y,y*,z,e are seen as families of non commutative 
indeterminates (without any algebraic relation) instead of non commutative random variables. Remark 
that, by definition, for all j = 1, . . . ,p the non commutative random variable Wj equals Pj{xj,Zj,e). 
Hence it follows as expected that 

P(Wjv, Yjv, Y^) OrN,sN 
OsN,rN OsN 



= P(Xjv, Yjv, YJ^,Zjv,ejv), 
eoP(w,y,y*) = P(x, y, y*, z, e). 

□ 



It is well known as a generalization of Voiculescu's theorem that, under Assumption 1 separately for 
z[^\ , Zp^\ Yjv and by independence of the families, with probability one the non commutative law 
of (Wjv, Yjv) in (Mjv(C), .*, tjv) converges to the non commutative law of (w,y) in a C*-probability 
space {A, ■*,t, || • ||) with faithful trace, where 

1. w = {wi, . . . , Wp) are free selfadjoint non commutative random variables, 

2- y = (yi, • • • , Uq) is the limit in law of Yjv, 

3. w and y are free. 
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For any polynomial P in p + 2q non commutative indeterminates 



r[P(w,y,y*)] = lim t.at [P(W^, Y^, Y^) ] 



(r+s)iV 



P(Wn,Yn,Y%) OrN,sN 
OsN,rN OsN 



, . r + s 
iim T, 

N—foo r 

J' -|— g ~ ^ ~ ~ ~ 

lim Tir+s)N[PO^N,YN,Y*j^,Zpf,epf)] 

f [P(i,y,y*,z,e) ] 
f[eoP(w,y,y*) ], 



r 

r + s 



where the limits are almost sure. In particular we obtain that, for all polynomials P in p + 2q non 
commutative indeterminates, one has 



|eoF(w,y,r)ll = ||P(w, y, y*)|| 



(9.27) 



By Lemmas 
of Theorem 



9.3 



1.6 



and 



9.4 



the family of (r + s)iVx {r + s)N matrices (Yat, Zjv, gat) satisfies the assumptions 
hence for all polynomials P in ip + 2q + \ non commutative indeterminates, with P as 
in Lemma |9.5| almost surely one has 



P(X7v, Yat, Y^, Zjv, ejv) 



l^(x,y,y*,z,e)|| 



(9.28) 



Remark that 

||P(W^,Y^,Y^)|| 



P(WAr, Yat, Y^) OrN,sN 
OsN,rN OsN 



|P(Xjv, Yat, Y^, Zat, ejv) 



lP(i,y,y*,z,e)|| = |ieoP(w, y, y*)!! = ll^(w,y,y* 



Together with (9.281, this gives the expected result. 



9.3 Proof of Corollary 2.4: Rectangular band matrices 

We only give a sketch of the proof. Details are obtained by minor modification of the proofs of Corollaries 
[2^and|23] Let H be as in Corollary [2^ 

... \ 



H = 



f Ax A2 ... Al ... 
Ai Ai ... Al 
; Al A2 ... Al Q 



\ 







Al A2 





Al J 



(9.29) 



We start with the following observation: the operator norm of H is the square root of the operator norm 
of H*H, which is a square block matrix. Its blocks consist of sums of tN x tN matrices of the form A'^ A„i , 
l,m = 1 . . . L. By minor modifications of the proof of Corollary |2.2| we get the almost sure convergence 
of the normalized trace and of the norm for any polynomial in the matrices Aat — {A'^ Am)i,m=i..L as A'^ 
goes to the infinity. By Proposition |7. 3 1 we get that the convergences hold for square block matrices and 
in particular for any polynomial in H* H. Hence the result follows by functional calculus. 



A A theorem about norm convergence, by D. ShlyakhtenkcQ 

Lemma Let {A, t) be a C*-algebra with a faithful trace r, and consider B to be the universal C*-algebra 
generated by A and elements satisfying L^^^*xL^^'' — 5i^jT{x) for all x £ A. Moreover, 

consider the linear functional ij) determined on * — A\g{A, {L^^^}j) by: 



1 Research supported by NSF grant DMS-0900776 
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4>\a = t, 

tpixoL'-'-^^xi ■ ■ ■ Xk~iL'-'''^XkyQL'-J^^*yi ■ ■ ■ yi^iL'-J'^yi) = whenever xi, . . . , Xk, yo, . . . ,yi e A and at 
least one of k and I is nonzero. 

Then ip extends to a state on B having a faithful GNS representation. Moreover, {B, -ip) ~ [A, t)*(£, 0) 
where (£, 0) is the C*-algebra generated by n free creation operators ^i, . . . , on the full Fock space 
J^(C") and (j) is the vacuum expectation. 

Sketch of proof. Consider the A, A-Hilbert biniodule T-L = L'^{A,t) (g) A with the inner product 

and the left and right A actions given by 

X ■ a) ■ y — x^ 1^ ay. 

Let B be the extended Cuntz-Pimsner algebra associated to "H®" (see i.e. the universal C*-algebra 

generated by A and operators Lh : h G H satisfying the relations 

LlLg = {h,g}A, h,gen®" 
aLhb = Lahb, h en®"-, a,b e A. 

It follows from the results of [32 that if we denote by {B, ip) the free product [A, r) * {£, <j>), then: 

£*x£j = 5i=jT{x), Va; S A, 
ip{xoei^xi---Xk^i£i^XkyQ£*_^yi---yi-ie*^yi) = 0, yxi, ... ,Xk,yi, ... ,yi e A, k + I > 

If = iJ2^ ?f ® of ^)fc=i e (v4 (g) ^)®" C -H®" is a finite tensor, write 



(fe) 



It then follows that 



ei£g = {h,g)A, KgeW^^ 
aihb = iahb, a,beA, he H®" 

which in particular means that \\ih\\2 = Mh^hW — W^W^ so that the mapping h ih an isometry. We 
then extend to a map from "H®" into B. Note that the extension of £ still satisfies aihb = iahb whenever 
a,6 e A and /i e -H®". 

From this we see that (by the universal property of B) there exists a *-homomorphism tt : B ^ B, 
so that i/j = tp oTT. Thus all we need to prove is that tt is injective. But by [301 Prop. 3.3], it follows that 
B is isomorphic to the Toeplitz algebra T (since in this case obviously (H®",?£®")^ = A) acting on the 
Fock space T = ®j.>o(^®")'*'**^- If we denote by E the canonical conditional expectation from T onto 
A and consider the state 9 = t o E, then the resulting Hilbert space is the closure of T in the (faithful) 
norm ||^|| = ■'■((^, Oa)^''^; from this we see that the GNS representation of B associated to the state 9 on 
B is faithful. Since B is exactly this GNS representation, it follows that vr is injective. □ 

If Aat is a sequence of C*-algebras and uj e /?N \ N is a free ultrafilter, we shall denote by 
the quotient 



Then 21 is a C*-algebra. 



f[AN= lllAN\/[ia,)^^,:]imJaN\\^0] 
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Let now j = l,...,n, N = 1,2,... be self-adjoint random variables and assume that X^^\ 

j = 1, . . . , n are such that for any non-commutative polynomial P, 

r^(P(X«,...,x(;'))) ^ t(P(xW,...,X("))) 

Let L^^\ j = 1, . . . , n be a family of free creation operators, free from each other and from {Xjp}N,j U 
{X^^^j. In other words, they satisfy: 

We use the notations 

= C*{X^\...,X^), B;v = C*(xW,...,x(,"\lW,...,L(")) 

A = c*(x(i),...,x(")), b = c*(x(i),...,x("),lW,...,l(")) 

and we denote by and the respective states on A^^ and B^^ (= (Ajv,tjv) * {£,4')). We denote by 
T and the respective states on A and B (= (^, r) * {£, </>)). 
Consider now the ultrapowers 

The formula 

V' : (a;jv)?^=i ^ 1™ ''Pn{xn) 

N—mj 

defines a state on !B. 

We shall denote by X^^'^ G 21 the sequence {X^^)jLi. Then by assumption, we have that the map 
a taking X'^^^ to X^^^ extends to a state-preserving isomorphism from {A,t) into B with range A = 

c*(x(i),...,l(")). 

We shall also denote by L^^^ the constant sequence {L^-'^)'^_-^ G 05. Then for any element of A 
represented by the sequence x = {xn)n=i we have: 

which (since the and operator norms coincide on multiples of identity) is equal to r(a;)l^i=j G 21. It 
follows from the universality property that 

B=^C*{X^'^\..., Jt^"-^ , , . . . , ) 

is a quotient of {A, r) * {£, (j)), the quotient map j3 determined by the fact that it is a on ^ and takes ij 

to L^^^. On the other hand, if we consider the GNS-representation tt of B with respect to the restriction 
of we easily get (by freeness from A and {L^-'^}^) that the image is isomorphic to (A, r) * (f , 4>). Thus 
TT o /3 = id so that actually 

^ : (A, r) * (5, </.) ^ B = C* (X(^) , . . . , U^^ i^") ) 

is an isomorphism. 

Consider now a non-commutative ^-polynomial P. Then 

||P(X(1), . . . . ..l^^^)\kA,r)HS,<P) = \\P{X^^\ ■ ■ . . . . ,i("))||<8 

= lim ||P(X«,...,x(7\l«,...,L("))|U.. 

A/— >cu 

Since the left hand side does not depend on w, we have proved: 

Theorem A.l. Let X^-* e (Ajv,r]v), j = 1, . . . ,n, N = 1,2, . . . he self-adjoint random variables and 
assume that X^^^ e {A, t), j = 1, . . . ,n are such that for any non- commutative polynomial P, 

t(P(X«,...,x(;'))) ^ t(P(XW,...,X("))) 

\\p{x^^\...,x^-^)U^ ^ ||p(xw,...,x("))|u. 



REFERENCES 



39 



Let {£i, . . . ,in) e £ be free creation operators, andletBjsf = {£ , (p) * {Ajsf , tn) , B = {£,(1>)*{A,t). Assume 
that the traces tj are faithful. Then for any nan- commutative ^-polynomial Q, 

llo(xW,...,x(;\^i,...,f„)llB„ ^ llo(x(i),...,x("),fi,...,4)llB. 

It should be noted that if 5i, . . . , are free semicircular variables, free from {X^^}jv,jU{X(^^}j, then 

Cat = C* (X^^^ , . . . , , 5*1 , . . . , S'„) is isonictrically contained in En, while C = C* {X^^\ . . . , , S'l , . . . 
is isometrically contained in B. Thus the analog of Theorem A with £j's replaced by a free semicircular 
family also holds. 

References 

[1] G. W. Anderson, A. Guionnet, and O. Zeitouni. An Introduction to Random Matrices, volume 118 
of Cambridge studies in advanced mathematics. Cambridge University Press, 2010. 

[2] L. Arnold. On the asymptotic distribution of the eigenvalues of random matrices. J. Math. Anal. 

AppL, 20:262-268, 1967. 

[3] Z. D. Bai. Methodologies in spectral analysis of large-dimensional random matrices, a review. Statist. 
Sinica, 9(3):611-677, 1999. With comments by G. J. Rodgers and Jack W. Silverstein; and a rejoinder 
by the author. 

[4] Z. D. Bai, J. W. Silverstein, and Y. Q. Yin. A note on the largest eigenvalue of a large-dimensional 
sample covariance matrix. J. Multivariate Anal., 26(2): 166-168, 1988. 

[5] Z. D. Bai and Jack W. Silverstein. No cigcnvahics outside the support of the limiting spectral 
distribution of largc-dinicnsional sample covariance matrices. Ann. Probab., 26(l):316-345, 1998. 

[6] Z. D. Bai and Y. Q. Yin. Necessary and sufficient conditions for almost sure convergence of the 
largest eigenvalue of a Wigner matrix. Ann. Probab., 16(4):1729-1741, 1988. 

[7] Z. D. Bai, Y. Q. Yin, and P. R. Krishnaiah. On limiting spectral distribution of product of two 
random matrices when the underlying distribution is isotropic. J. Multivariate Anal., 19(l):189-200, 
1986. 

[8] N. P. Brown and N. Ozawa. C* -algebras and finite- dimensional approximations, volume 88 of Crad- 
uate Studies in Mathematics. American Mathematical Society, Providence, RI, 2008. 

[9] M. Capitaine and M. Casalis. Asymptotic freeness by generalized moments for Gaussian and Wishart 
matrices. Application to beta random matrices. Indiana Univ. Math. J., 53(2):397-431, 2004. 

[10] M. Capitaine and C. Donati-Martin. Strong asymptotic freeness for Wigner and Wishart matrices. 
Indiana Univ. Math. J., 56(2):767-803, 2007. 

[11] L. H. Y. Chen. An inequality for the multivariate normal distribution. J. Multivariate Anal., 
12(2):306-315, 1982. 

[12] J. B. Conway. A course in operator theory, volume 21 of Craduate Studies in Mathematics. American 
Mathematical Society, Providence, RI, 2000. 

[13] K. Dykema. On certain free product factors via an extended matrix model. J. Funct. Anal., 

112(l):31-60, 1993. 

[14] Z. Fiiredi and J. Komlos. The eigenvalues of random symmetric matrices. Combinatorica, 1(3):233- 
241, 1981. 

[15] S. Geman. A limit theorem for the norm of random matrices. Ann. Probab., 8(2):252 261, 1980. 

[16] U. Grenander and J. W. Silverstein. Spectral analysis of networks with random topologies. SIAM 
J. Appl. Math., 32(2):499-519, 1977. 



REFERENCES 



40 



[17] A. Guionnet. Large random matrices: lectures on macroscopic asymptotics, volume 1957 of Lecture 
Notes in Mathematics. Springer- Verlag, Berlin, 2009. Lectures from the 36tli Probability Summer 
School held in Saint-Flour, 2006. 

[18] A. Guionnet, M. Krishnapur, and O. Zeitouni. The single-ring theorem. arXiv:0909.2214vl, preprint, 
http: / /arxiv4.1ibrary.cornell.edu/abs/0909.2214. 

[19] U. Haagerup and S. Thorbj0rnsen. A new application of random matrices: Ext(C*gj(F2)) is not a 
group. Ann. of Math. (2), 162(2):711-775, 2005. 

[20] H. Hamburger. Uber eine Erweiterung des Stieltjesschen Momentenproblems. Math. Ann., 82(3- 
4):168-187, 1921. 

[21] F. Hiai and D. Petz. Asymptotic freeness almost everywhere for random matrices. Acta Sci. Math. 
(Szeged), 66(3-4) :809-834, 2000. 

[22] D. Jonsson. Some limit theorems for the eigenvalues of a sample covariance matrix. J. Multivariate 
Anal, 12(l):l-38, 1982. 

[23] D. Jonsson. On the largest eigenvalue of a sample covariance matrix. In Multivariate analysis VI 
(Pittsburgh, Pa., 1983), pages 327-333. North-Holland, Amsterdam, 1985. 

[24] F. Juhasz. On the spectrum of a random graph. In Algebraic methods in graph theory. Vol. I, 
II (Szeged, 1978), volume 25 of Colloq. Math. Soc. Jdnos Bolyai, pages 313-316. North-Holland, 
Amsterdam, 1981. 

[25] E. G. Larsson and P. Stoica. Space-time block coding for wireless communications. Cambridge 
University Press, Cambridge, 2003. 

[26] F. Lchncr. Computing norms of free operators with matrix coefficients. Amer. J. Math., 121(3):453- 
486, 1999. 

[27] V. A. Marcenko and L. A. Pastur. Distribution of eigenvalues in certain sets of random matrices. 
Mat. Sb. (N.S.), 72 (114):507-536, 1967. 

[28] A. Nica and R. Speicher. Lectures on the combinatorics of free probability, volume 335 of London 
Mathematical Society Lecture Note Series. Cambridge University Press, Cambridge, 2006. 

[29] D. Paul and J. W. Silverstein. No eigenvalues outside the support of the limiting empirical spectral 
distribution of a separable covariance matrix. J. Multivariate Anal., 100(l):37-57, 2009. 

[30] M. V. Pinisncr. A class of C*-algebras generalizing both Cuntz-Krieger algebras and crossed products 
by Z. In Free probability theory (Waterloo, ON, 1995), volume 12 of Fields Inst. Commun., pages 
189-212. Amer. Math. Soc, Providence, RI, 1997. 

[31] H. Schultz. Non-commutative polynomials of independent Gaussian random matrices. The real and 
symplectic cases. Probab. Theory Related Fields, 131(2):261-309, 2005. 

[32] D. Shlyakhtenko. Some applications of freeness with amalgamation. J. Reine Angew. Math., 500:191- 
212, 1998. 

[33] J. W. Silverstein. The smallest eigenvalue of a large-dimensional Wishart matrix. Ann. Probab., 

13(4):1364-1368, 1985. 

[34] J. W. Silverstein. On the weak limit of the largest eigenvalue of a large-dimensional sample covariance 
matrix. J. Multivariate Anal., 30(2):307-311, 1989. 

[35] S. Thorbj0rnsen. Mixed moments of Voiculescu's Gaussian random matrices. J. Funct. Anal., 
176(2):213-246, 2000. 

[36] A. M. Tulino and S. Verdu. Random matrices and wireless communications, volume vol. 1 of Fun- 
dations and Trends in Communications and Information Theory. Now Publishers Inc., 2004. 



REFERENCES 



41 



[37] D. Voiculescu. Limit laws for random matrices and free products. Invent. Math., 104(l):201-220, 
1991. 

[38] D. Voiculescu. Operations on certain non-commutative operator-valued random variables. 
Asterisque, (232):243-275, 1995. Recent advances in operator algebras (Orleans, 1992). 

[39] D. Voiculescu. A strengthened asymptotic freeness result for random matrices with applications to 
free entropy. Intemat. Math. Res. Notices, (l):41-63, 1998. 

[40] K. W. Wachter. The strong limits of random matrix spectra for sample matrices of independent 
elements. Ann. Probability, 6(1):1-18, 1978. 

[41] E. P. Wigncr. On the distribution of the roots of certain symmetric matrices. Ann. of Math. (2), 
67:325-327, 1958. 

[42] Y. Q. Yin. Limiting spectral distribution for a class of random matrices. J. Multivariate Anal, 
20(l):50-68, 1986. 

[43] Y. Q. Yin, Z. D. Bai, and P. R. Krishnaiah. On the limit of the largest eigenvalue of the large- 
dimensional sample covariance matrix. Probab. Theory Related Fields, 78(4):509-521, 1988. 

[44] Y. Q. Yin and P. R. Krishnaiah. A limit theorem for the eigenvalues of product of two random 
matrices. J. Multivariate Anal, 13(4):489-507, 1983. 



